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Abstract 

This  report  represents  the  fourth  year  of  research  performed  under  the 
auspices  of  the  Joint  Services  Electronics  Program  at  Texas  Tech  University. 
The  program  is  concentrated  in  the  "information  electronics"  area  and  in¬ 
cludes  researchers  from  both  the  departments  of  Electrical  Engineering  and 
Mathematics.  Specific  work  units  deal  with  Feedback  System  Design,  Nonlinear 
Control,  Nonlinear  Fault  Analysis,  Detection  and  Estimation  in  Imagery,  Multi¬ 
dimensional  System  Theory,  and  Pointing  and  Tracking. 

Each  work  unit  is  represented  in  the  report  by  a  summary  of  the  work 
performed  during  the  past  year,  a  list  of  publications  and  activities  in  the 
area,  reprints  of  a1!  papers  which  have  been  published  during  the  past  year, 
and  abstracts  of  pending  papers.  In  addition,  the  report  includes  lists  of 
all  grants  and  contracts  administered  by  JSEP  personnel,  the  department  of 
Electrical  Engineering  and  the  Department  of  Mathematics;  and  a  list  of 
all  publications  prepared  by  JSEP  personnel. 
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Significant  Accomplishments  Report 


A.  Nonlinear  Fault  Analysis 

During  the  past  year  we  have  made  a  major  change  in  the  direction  of 
our  research  in  the  nonlinear  fault  analysis  area  which,  we  believe,  will 
open  up  the  way  for  a  whole  new  approach  to  the  subject.  Hitherto,  our 
research  had  been  directed  towards  the  development  of  multiple  test  vector 
simulation-after-test  algorithms.  Although  such  algorithms  work  well  in  the 
linear  case  they  require  too  much  on-line  computer  time  to  be  effective  in 
the  nonlinear  case.  As  such,  we  have  turned  our  attention  toward  simulation- 
before-  test  algorithms  and  single  test  vector  simulation-after-test  algorithms 
during  the  past  year  with  considerable  success  in  both  areas. 

The  basic  problem  with  simulation-before-test  algorithms  is  the  large 
amount  of  off-line  computer  time  required  to  generate  the  fault  dictionary 
which  underlies  the  technique.  Although  this  is  also  a  problem  in  digital 
testing  it  is  greatly  exaggerated  in  the  analog  case  by  the  continuous  nature 
of  the  failure  phenomena,  tolerance  problems,  modeling  problems,  and  the  high 
cost  of  analog  simulation.  As  such,  we  have  developed  a  new  differential- 
interpolative  approach  to  the  simulation-before-test  concept  which  allows  one 
to  locate  a  failure  which  lies  between  the  simulated  faults  and/or  failures 
which  have  been  perturbed  by  tolerance  effects.  This,  in  turn,  allows  the 
number  of  entries  in  the  fault  dictionary  to  be  reduced  with  a  commensurate 
reduction  in  computer  costs. 

Our  second  approach  is  a  single  test  vector  simulation-after-test 
algorithm  which  uses  a  "restricted  number  of  failures"  assumption  to  reduce 
the  number  of  test  points  employed.  Historically,  single  test  vector 
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simulation-after-test  algorithms  have  always  been  highly  attractive  in 
that  they  are  simple  and  easy  to  use  and  have  minimal  on-line  and  off-line 
computational  requirements.  Unfortunately,  the  applicability  of  these 
algorithms  has  been  limited  by  the  large  number  of  test  points  which  they 
require.  By  taking  advantage  of  the  fact  that  at  most  three  or  four  com¬ 
ponents  will  ever  fail  simultaneously,  however,  we  have  been  able  to  decrease 
the  test  point  requirements  for  the  algorithm  while  retaining  its  other 
positive  attributes. 

B.  Detection  and  Estimation  in  Imagery 

During  the  past  year  we  have  completed  a  study  of  the  detection  and 
estimation  problem  in  imagery.  Although  the  mathematics  for  such  a  problem 
is  similar  to  that  encountered  in  the  more  classical  communications  problem 
the  problem  is  greatly  complicated  by  the  nonlinear  character  of  the  noise 
phenomena  and  the  high  data  rates  encountered.  In  this  endeavor  we  have 
developed  an  optimal  estimation  theory  and  compared  it  with  various  approximate 
and  sub-optimal  approaches.  In  particular,  it  was  shown  that  one  could  not 
approximate  the  nonlinear  noise  phenomena  by  a  linear  term  but  one  could 
develop  sub-optimal  nonlinear  algorithms  whose  performance  approximated  that 
of  the  optimal  algorithm  while  achieving  a  cost  reduction.  Indeed,  from  a 
practical  point  of  view  the  sub-optimal  algorithms  were  actually  superior  to 
the  optimal  algorithms  because  of  their  greater  robustness  to  modeling 
errors.  Moreover,  unlike  the  optimal  algorithms  they  may  be  implemented  in 
"real  time"  at  video  data  rates. 

C.  Pointing  and  Tracking 

Much  of  our  research  in  this  area  during  the  past  year  has  been  devoted 

to  the  development  of  efficient  computer  algorithms  for  the  implementation  of 
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our  Lie  theoretic  pointing  and  tracking  theory  developed  previously. 
Specific  emphasis  has  been  placed  on  the  development  of  algorithms  which 
are  insensitive  to  the  noise  phenomena  encountered  in  video  imagery  and 
in  algorithms  which  have  the  potential  for  real  time  implementation. 
Several  of  these  algorithms  have  now  been  experimentally  implemented  while 
we  are  waiting  for  the  delivery  of  our  image  processing  system  to  begin 
experimental  "real  time"  implementation  of  the  theory  using  actual  video 
tracking  data. 
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Thus  far  we  have  formulated  a  complete  parameterization  for  the  set  of 

compensators  which  stabilize  a  given  plant  and/or  cause  it  to  track  or 
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reject  a  prescribed  family  of  inputs.  *  *  This  theory  has,  in  turn, 

been  applied  to  the  problem  of  designing  robust  and  adaptive  control 

systems.  In  particular,  we  have  developed  a  theory  for  the  simultaneous 

stabilization  of  two  distinct  plants^  by  a  single  compensator  and  we  have 
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Feedback  System  Design:  The  Fractional 
Representation  Approach  to  Analysis 

and  Synthesis 

C.  A.  DESOER,  fellow,  IEEE,  RUEY-WEN  LIU,  JOHN  MURRAY,  and  RICHARD  SAEKS,  fellow,  ieee 


Abstract — The  problem  of  designing  ■  feedback  system  with  prescribed 
properties  is  attacked  via  a  fractional  representation  approach  to  feedback 
system  analysis  and  synthesis.  To  this  end  we  let  H  denote  a  ring  of 
operators  with  the  prescribed  properties  and  model  a  given  plant  aa  the 
ratio  of  two  operators  in  H.  This,  in  turn,  leads  to  a  simplified  teat  to 
determine  whether  or  not  a  feedback  system  in  which  that  plant  la 
embedded  has  the  prescribed  properties  and  a  complete  charartrri  ration  of 
those  compensators  which  will  “place”  the  feedback  system  In  H.  The 
theory  la  formulated  axlomadcally  to  permit  Its  application  in  a  wide 
variety  of  system  design  problems  and  is  extremely  elementary  In  nature 
requiring  do  more  than  addMoo,  muhl plication,  subtraction,  and  lavenioa 
for  Ha  derivation  even  In  the  most  general  vettings. 


I.  Introduction 

INTUITIVELY,  the  linear  feedback  system  design  pro¬ 
cess  may  be  broken  down  into  three  steps:  modeling, 
analysis,  and  synthesis;  each  of  which  may  be  carried  out 
via  a  multiplicity  of  time  and  frequency  domain  tech¬ 
niques.  In  engineering  practice,  however,  the  three  steps 
are  loosely  matched  to  one  another.  The  purpose  of  the 
present  paper  is  to  use  fractional  representation  models  to 


Manuscript  received  April  2,  1979;  revised  October  15,  1979.  Paper 
recommended  by  B.  Francis,  Chairman  of  the  Linear  Systems  Com¬ 
mittee.  The  work  of  C.  A.  Desocr  was  supported  in  pan  by  tbe  Joint 
Services  Electronics  Program  at  the  University  of  California,  Berkeley, 
under  AFOSR  Contract  76-C-QIOO.  The  work  of  R.-W.  Liu  was  sup¬ 
ported  in  part  by  ONR  Contract  78-C-0444.  The  work  of  J.  Murray  and 
R.  Sacks  was  supported  in  part  by  the  Joint  Services  Electronics  Pro¬ 
gram,  Texas  Tech  University,  undo-  ONR  Contract  76-C-l  136. 

C.  A.  Desocr  is  with  tbe  Department  of  Electrical  Engineering  and 
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Fig.  ).  Single-variate  control  system. 

the  analysis  and  synthesis  of  feedback  systems.  Here,  if 
one  desires  to  design  a  system  with  prescribed  properties 
the  given  plant  is  initially  modeled  as  a  quotient  of  two 
operators,  each  of  which  has  the  desired  properties.  Once 
such  a  model  has  been  specified  a  similar  model  may  be 
formulated  for  the  feedback  system  constructed  from  that 
plant  which,  in  turn,  may  be  used  to  determine  whether  or 
not  the  feedback  system  has  the  desired  properties.  More¬ 
over,  the  set  of  compensators  which  will  cause  the  feed¬ 
back  system  to  have  the  prescribed  properties  may  be 
completely  characterized  in  terms  of  such  a  model.  As 
such,  by  choosing  a  model  for  the  plant  which  is  matched 
to  the  design  criteria  the  analysis  and  synthesis  processes 
for  a  feedback  system  may  be  greatly  simplified. 

These  ideas  are  illustrated  by  the  following  derivation 
of  the  set  of  stabilizing  compensators  for  the  single  variate 
control  system  of  Fig.  1. 

We  say  that  a  transfer  function  p(s)  is  exponentially 
stable  (exp.  stable)  if  p(s)  is  a  proper  rational  function  with 
poles  having  negative  real  parts.  Although  the  plant  may 
naturally  be  modeled  as  a  quotient  of  coprime  polynomi¬ 
als  (16),  [19]  />(*)-  a{s)/b{s)  since  our  ultimate  goal  is  a 
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stable  system  we  prefer  to  model  p(s)  as  a  quotient  of  exp. 
stable  rational  functions 

;>(j)-n(s)/^(s)-[a(j)/m(j)][f>(s)/m(s)]'1  (1.1) 

where  m(s)  is  strictly  Hurwitz  polynomial  of  degree  equal 
to  the  degree  of  b(s).  Moreover,  since  a(s)  and  b(s)  are 
coprime,  the  rational  functions  n(s)  and  d(s)  are  coprime 
in  the  sense  that  there  exist  exp.  stable  rational  functions 
u(s)  and  u(r)  such  that 

u(s)n(s)  + v(s)d(s)~  1.  (1.2) 

Similarly,  we  assume  that  our  compensator  is  modeled  as 
a  quotient  of  exp.  stable  rational  functions,  c(s)  = 
x(s)/y(s),  which  are  coprime  in  the  above  sense.  Now,  a 
little  algebra  will  reveal  that  the  closed-loop  system  trans¬ 
fer  function  from  input  u  to  output  y  is  given  by  a  ratio  of 
exp.  stable  rational  functions  in  the  form 

M J) =  "(*)  [  r(*Ms)  +  ]  ~  '  *(•*)•  ( I  -3) 

Moreover,  it  can  be  shown1  that  h  (s)  will  be  stable  if  and 
only  if 

[y(j)d(s)  +  x(j)n(s)]=*A:(s)  (1.4) 

has  an  exp.  stable  inverse.  Since  k(s)  is,  itself,  exp.  stable 
this  implies  that  the  feedback  system  will  be  exp.  stable  if 
and  only  if  fc(s)  is  nonzero  for  all  Res  >  0,  including  oo. 
An  exp.  stable  function  with  these  properties  is  called 
miniphase.  As  such,  the  problem  of  synthesizing  an  exp. 
stable  feedback  system  reduces  to  the  solution  of  (1.4)  for 
exp.  stable  rational  functions  x(r)  and  y(s)  given  exp. 
stable  functions  n(s)  and  d(s)  and  a  miniphase  function 
k(s). 

By  direct  substitution  one  may  verify  that 

yk(s)-r(s)n(s)  and  x*(s)- -r(s)d(s)  (1.5) 

satisfy  the  homogeneous  equation 

y\s)d{s)  +  x>'(s)n(s)-  0  (1.6) 

for  all  exp.  stable  rational  functions  r(r).  Moreover,  since 
n(s)  and  d(s)  are  coprime  it  follows  that  all  exp.  stable 
rational  solutions  of  (1.6)  are  of  this  form  (15),  (18).  On  the 
other  hand,  a  particular  solution  of  (1.4)  may  be  obtained 
by  multiplying  (1.2)  by  k(s),  which  yields 

y'(j)  —  k(s)v(s)  and  xp(s)~  k(s)u(s).  (1.7) 

As  such,  if  we  let  r(j)  vary  over  the  set  of  exp.  stable 
rational  functions  and  k(s)  vary  over  the  set  of  miniphase 
functions  we  obtain  a  complete  parameterization  of  the 
stabilizing  compensators  for  our  feedback  system  in  the 

'See  the  axiomatic  derivation  of  Section  III  for  the  details. 


form 

x(s)  _  [*(sMj)-  /-(j)<f(j)] 

>(•*)  [A(s)c(r)+/-(j)/?(s)j 

[n(s)-w(s)r/(s)] 

[t)(s)+w(s)n(f)] 

where  w(s)  —  r(s)  /  k(s)  ranges  over  the  exp.  stable  rational 
functions. 

A  comparison  of  (1.8)  with  the  class  of  stabilizing 
compensators  derived  by  Youla,  Bongiomo,  and  Jabr 
(24),  (25),  [29]  will  reveal  that  the  two  results  differ  only  in 
that  our  u(s),  t?(s),  n(s),  and  d(s)  are  exp.  stable  rational 
functions  while  theirs  are  polynomials.2  Unlike  their 
analytic  derivation,  however,  the  above  result  was  ob¬ 
tained  via  elementary  algebraic  operations.  Indeed,  the 
only  properties  of  the  exp.  stable  rational  functions  em¬ 
ployed  are  their  closure  under  addition  and  multiplication 
together  with  the  fact  that  the  identity  is  an  exp.  stable 
rational  function,  i.e.,  the  exp.  stable  rational  functions 
form  a  ring  with  identity.  As  such,  if  the  exp.  stable 
rational  functions  of  the  above  derivation  were  to  be 
replaced  by  any  prescribed  ring  of  single-input  single-out¬ 
put  systems,  (1.8)  would  yield  a  complete  characterization 
of  the  compensators  which  would  “place”  the  feedback 
system  in  that  ring.  If  one  works  with  a  ring  of  rational 
functions  with  poles  in  a  prescribed  region  a  solution  of 
the  pole  placement  problem  is  obtained  (18J,  whereas,  if 
one  chooses  to  work  with  stable  transcendental  functions 
a  solution  to  the  stabilization  problem  for  distributed 
systems  is  obtained  (7),  (8)  etc.  Indeed,  with  minor  modifi¬ 
cations  the  derivation  can  be  extended  to  noncommuta- 
tive  rings  thereby  including  multivariate  and  time-varying 
systems.  In  each  case,  a  simple  solution  to  a  fundamental 
problem  of  feedback  system  design  is  obtained  by  virtue 
of  choosing  a  model  for  the  given  plant  which  is  matched 
to  the  ultimate  goal  of  the  design  problem.  In  particular,  if 
we  desire  to  design  a  feedback  system  which  lies  in  a 
prescribed  ring  of  operators  we  model  the  plant  as  a 
quotient  of  operators  from  that  ring. 

Consistent  with  the  above  philosophy  the  following 
section  of  the  paper  is  devoted  to  the  formulation  of  an 
axiomatic  theory  of  fractional  system  representation. 
Here,  a  given  system  is  modeled  as  a  quotient  of  two 
operators  lying  in  a  prescribed  ring  H.  The  corresponding 
feedback  system  analysis  and  synthesis  problems  are  then 
studied  in  the  succeeding  sections.  In  particular.  Section 

III  is  devoted  to  the  problem  of  determining  whether  or 
not  a  feedback  system  lies  in  H  given  that  its  plant  is 
represented  as  a  quotient  of  systems  from  H  while  Section 

IV  is  devoted  to  the  problem  of  characterizing  those 
compensators  which  will  “place”  the  feedback  system  in 
H.  The  resultant  axiomatic  theory  of  feedback  system 
design  is  applicable  to  multivariate,  time-varying,  distrib- 

JFrom  i  computational  point  of  view,  it  is  more  convenient  to  repre- 
sent  rational  functions  as  ratios  of  polynomials,  as  per  Youla  et  ai. 
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Table i 

Examples  of  the  Axiomatic  System (C,H,!,J) 


• 

Rls) 

R,<«) 

R(i)‘" 

R.(«r“ 

Also) 

Rio)*" 

UlR) 

B(H) 

R(i] 

/?(».) 

Ri«r 

A.(Oo) 

A.  (<.„)“* 

HJR) 

QK) 

1 

R[()»0 

K’(ot) 

m  « R(,r 

<.t. 

1  M(<)|  **  0 

M  <  K(a,)‘“ 
ll. 

**<«>.) 

M  «  Ajo%)‘“ 

ft.L 

1  M(*)|  t 

m  <  H  JR) 

>1. 

C.1H) 

1 

m  t  R(l] 

S.L 

m<»)  «  c  **  0 

m  «  1C  (<»•) 
t.t.  m<*)  f*  0 
Tor  i «  Cff. 

1  M(»)U  R"(o.) 
a  1  M(i)j  *o 
for  i  <  C„. 

M.a, 

1  M(»)|t/4*(o«) 

1  M(.)|  0 

for  •  <  C„. 

.  "t 

m  <  HJR)n. 
inf|  mOtt.)||  >0 
Amu  outer 

CQH) 

ca 

19 

31 

19 

13.18 

4.  31 

6,7,8 

12 

IMS 

R(l)  *  rational  functions  with  real  cocCictents 

RUsI  ■  proper  rational  (unctions  with  real  coeficicnu 

X-  w  n  by  n  matrices  of  elements  in  X 

A  ■  dtsinbuuonsof  the  form  |it^^|At-t )  whereat)  is  art 

mtegrabk  function  a.t.  f(t)  *  0  for  t  <0.  g,  is  • 
summablc  sequence  and  O-t#  <  ti  <  !i  <  .... 

A_(o«)  *  Laplace  transforms  of  distnbuuons  g  such  that  gt)c 
is  vn  A  for  some  a  i^ot 

A  7(o.)  *  multiplicative  subset  of  4_(o*l  consisting  of  elements 

bounded  away  from  zero  at*. 

bioil  ■  quotients  of  dementi  of  the  form  m/o  where 
m  «  AJao)  and  n  < 

R(sJ  ■  polynomials  with  real  coeficiem* 

C*-  *  compica  numbers  with  real  part  greater  than  or  equal  to  o* 


R(o»)  “  proper  rational  functions  with  real  coftcients  which  arc 

analytic  ut  Cg . 

R  *(«•)  ■  proper  rational  functions  with  real  coefTicienu  which 
arc  analytic  in  C_ ,  and  norucro  at  • 

"i 

B(H)  *  bounded  linear  operators  on  a  Hilbert  Space  H. 

C(H)  “  causal  bounded  linear  operators  on  a  Hilbert  space  H. 

C*(H)  *  causal  bounded  linear  operators  with  a  bounded  inverse 

on  a  Hilbert  space  H. 

CC(H)  «  causal  bounded  linear  operators  with  a  causal  bounded 
inverse  on  a  Hilbcn  space  H. 

L  (R)  *  essentially  bounded  Lcbesque  measurable  functions 

defined  oo  R. 


H_(R)  -  the  Hardy  space  of  essentially  bounded  Lebesquc 
measurable  functions  defined  on  R  which  have  an 
analytic  extension  into 


uted,  and  some  multidimensional  systems  and  includes 
the  stabilization,  pole  placement,  and  feedforward  design 
problems.  Several  of  these  applications  are  illustrated  by 
the  examples  of  Section  V.  In  the  final  section  of  the 
paper  a  partial  generalization  of  the  theory  to  nonlinear 
systems  is  described.  This  follows  the  algebraic  pattern 
established  in  the  linear  case  but  is  formulated  in  terms  of 
a  left-distributive  ring  to  model  the  properties  of  a  nonlin¬ 
ear  system  123). 

II.  Axiomatic  Theory 

Table  I  displays  several  examples  of  the  axiomatic 
system  developed  below.  Reference  to  it  will  help  in 
visualizing  the  breadth  and  significance  of  the  theory. 
Additional  examples  also  appear  in  Section  V. 

Let  G  be  a  (not  necessarily  commutative)  ring  with 
identity  and  let  H  be  a  subring  of  C  which  includes  the 
identity.  The  feedback  system  and  its  subsystems  will  be 
represented  by  operators  which  are  elements  of  G.  The 
compensator  will  be  chosen  so  that  the  overall  system  will 
be  represented  by  an  operator  in  the  subring  H. 

We  define  two  multiplicative  subsets  (2), (27]  of  H, 

I-{heH\h~'eG},  (2.1) 

i.e.,  I  is  the  set  of  elements  of  H  which  have  an  inverse  in 
G; 

J-{h<=.H\h-'€.H},  (2.2) 

i.e.,  J  is  the  subgroup  of  H  consisting  of  all  invertible 


elements  of  H.  Note  that 

JCICHCG.  (2.3) 

Given  the  above  structure  we  say  that  a  system  g  6  G 
has  a  right  fractional  representation  in  { G,H,I,J )  if  there 
exist  nr&H  and  drE.I  such  that  g  —  nrd~'.  Furthermore, 
we  say  that  the  pair  (n„dr)£H  x  H  is  right  coprime  if 
there  exist  ur  and  o,  in  H  such  that 

urnr  +  vrdr-\.  (2.4) 

The  right  fractional  representation  nrd~'  in  { G,  H,  I,J }  is 
said  to  be  right  coprime  if  the  pair  ( nr,dr )  is  right  coprime. 

The  relationship  between  our  concept  of  coprimeness 
and  the  usual  common  factor  criterion  for  coprimeness 
[28]  is  given  by  the  following  properties. 

Property  l:  Let  the  pair  (/»,, dr)SH  x  H  be  right 
coprime.  Let  n,  and  dr  have  a  common  right  factor  r&H, 
i.e.,  nr -  xrr,  dr  —  yrr  for  some  x,g  H  and  yr€H.  Then  r 
has  a  left  inverse  in  H. 

Proof:  Substitute  the  assumed  factorizations  of  n, 
and  dr  into  (2.4)  and  obtain 

urnr  +  vrdr  «(«,*,  +  vj,)r  - 1.  (2.5) 

Since  H  is  a  ring,  urxr  +  vryr  €  H.  From  (2.5)  it  follows 
that  r~  L  —  urx,  +  vry,  is  a  left-inverse  of  r.  ■ 

Property  2:  Let  g  —  n,d~ 1  be  a  right  coprime  fractional 
representation  of  g  in  { G,H,I,J).  Let  g-  W  be  a 
second  (not  necessarily  coprime)  right  fractional  repre¬ 
sentation  of  g  in  { G,H,I,J ).  Then  there  exists  an  r  in  H 
such  that 

xr“n,r  and  yr - drr.  (2.6) 
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Proof:  Given  the  two  factorizations  of  g,  let  r« 
d~  |y,;  hence  r£  G.  Then 

y,-d,r  (2.7) 

and,  performing  calculations  in  the  ring  G ,  we  obtain 

(M,~  ')>,  -  V,)  -  h,/--  (2.8) 

From  (2.7)  and  (2.8),  r  is  a  common  right  factor  of  x,  and 
y,.  To  show  that  r£//,  consider 

r  —  d~  'y,  »*  {urnr  +  vrd,)d~  tyr «  urnrd~  \r  +  v,y, 

-  urgyr  +  CJ,  -u,xr  +  vryr  g  H  (2.9) 

where  we  used  the  equality  g  =*  x,y~ 1  =*  nrd~ 1  to  derive 
(2-9).  ■ 

Although  G  is,  in  general,  a  noncommutative  ring,  the 
entire  theory  developed  above  for  right  fractional  repre¬ 
sentations  can  be  replicated  for  left  fractional  representa¬ 
tions.  In  particular,  we  say  that  g  £  G  has  a  left  fractional 
representation  in  {G,H, I,J)  if  there  exist  n,&H  and  d,  £ / 
such  that  g  -  Furthermore  we  say  that  the  pair 

(rt,,d,)6  H  X  H  is  left  coprime  if  there  exist  u,  and  v,  in  H 
such  that 

n,u,  +  d,v,  =•*  1.  (2. 10) 

The  left  fractional  representation  d,~'n,  is  said  to  be  left 
coprime  if  the  pair  (n„dt)  is  left  coprime.  With  these 
definitions  the  existence  of  a  common  left  factor  [or  a  left 
fractional  representations  of  g  is  characterized  by  the 
following  properties. 

Property  1':  Let  the  pair  (n„dt)  be  left  coprime.  Let  n, 
and  d,  have  a  common  left  factor  I  'm  H,  i.e.,  n,  —  lx,, 
d,  —  /y,  for  some  x,GH  and  y,  £  H.  Then  l  has  a  right 
inverse  £  H. 

Property  2':  Let  g**d,~ln,  be  a  left  coprime  fractional 
representation  of  g  ia  { G,ff,I,J }.  Let  g  —  y,~ xx,  be  a 
second  (not  necessarily  coprime)  left  fractional  repre¬ 
sentation  of  g  in  { G,H,I,J }.  Then  there  exists  an  /  in  H 
such  that 

x, » In,  and  yt  ”  Id,.  (2.11) 

The  above  properties  of  a  coprime  fractional  repre¬ 
sentation  have  all  been  derived  under  the  assumption  that 
such  a  representation  exists.  Of  course,  if  G  denotes  the 
rational  matrices  and  H  denotes  the  polynomial  matrices 
the  existence  of  a  coprime  representation  is  implied  by 
classical  analysis  [16],  (19).  Indeed,  the  classical  analysis 
readily  extends  to  the  case  where  H  is  taken  to  be  the  exp. 
stable  rational  matrices  or  the  ring  of  proper  rational 
matrices  with  poles  in  a  prescribed  region  [18].  On  the 
other  hand  for  multidimensional  [26],  distributed  [4],  [8], 
and  time-varying  systems  [U],(15]  there  is  no  assurance 
that  an  arbitrary  g€  G  will  admit  a  fractional  representa¬ 
tion  nor  even  that  the  set  of  g£G  which  admit  such  a 
representation  will  be  a  linear  space.  Moreover,  all  g’s 
which  admit  a  fractional  representation  may  not  admit  a 
coprime  fractional  representation  [26].  In  general,  the  set 


of  g£G  which  admit  a  fractional  representation  in 
{ G,H,I,J }  will  form  a  subnng  of  G  if  and  only  if  the  Ore 
condition3  is  satisfied  while  criteria  for  coprimeness  have 
been  formulated  in  various  special  cases  though  no  gen¬ 
eral  theory  exists  [1],[4],[26].  The  standard  condition  for 
the  existence  of  fractional  representations  which  are 
coprime  in  the  sense  of  (2.4)  is  that  H  be  a  right  principal 
ideal  domain. 

Reference  to  Table  I  shows  that  in  applications  it  is 
important  to  have  conditions  under  which  g  will  be  in  H 
and  these  conditions  should  be  expressed  in  terms  of  its 
fractional  representation. 

Property  3:  Let  g  »  nrd~ 1  with  n,  £  H  and  d, £  1. 

a)  If  d, 67,  then  g£/f. 

b)  If  g  *  nrd~ 1  is  a  right  coprime  fractional  representa¬ 
tion  of  g  in  (G, //,/,./},  then  g€.H  implies  that  dtEJ. 

Proof: 

a)  We  have  d,  £/;  hence  by  (2.2),  d~‘sH  and  thus 
n,d~ 1 »  g  e  H. 

b)  We  have  gSH.  Furthermore,  nr  —  gdr,  dr  —  \dr  im¬ 

plies  that  d,  is  a  right  common  factor  of  nr  and  dr;  hence 
by  Property  1,  dr  has  a  left  inverse  in  H.  But  dr£l  by 
assumption,  so  d~*  exists  and  is  an  element  of  G,  thus 
d~ 1  -  d~LSH;  hence,  by  (2.2),  dreJ.  M 

Property  3':  Let  g  =  df  'n,  with  n,e.H  and  d,  E  I. 

a)  If  </,€/,  then  g£7/. 

b)  If  gmd,~xn,  is  a  left  coprime  fractional  representa¬ 
tion  of  g  in  (G, //, /,/),  then  gBH  implies  that  d;£J. 

Property  4:  Let  g  *  nrd  ~  'n,  where  nr,  n,  g  H,  and  d  £  /. 

a)  If  dsJ,  then  ge//. 

b)  Let,  in  addition,  nrd~l  be  a  right  coprime  frac¬ 
tional  representation  in  { G,H,I,J }  and  d~'n,  be  a  left 
coprime  fractional  representation  in  { G,H,I,J}\  thengg 
H  implies  that  dGJ. 

Proof: 

a)  By  assumption,  </£/;  hence  d~l€.H.  So  g«* 
nrd  ~  'nf  £  H. 

b)  Since  d~'n,  is  a  left  coprime  fractional  representa¬ 
tion  there  exist  u,,  v,EH  such  that 

n,u,  +  dv,~\,  (2.12) 

thus, 

nrd  ~ 1  -  nrd  ~  x{n,u,  +  dv,)  -  n,d  ~  'n,u,  +  n,v,  ■»  gu,  +  nrv,. 

(2.13) 

Now  g£H  hence  (2.13)  gives  nrd _  1  £ //.  By  Property  3, 
nrd~'eH  together  with  the  fact  that  the  pair  (n„d)  is 
right  coprime  implies  d&J.  ■ 

III.  Analysis 

To  start  with  consider  the  feedback  system  Z,  of  Fig.  2. 
Suppose  that  the  plant  is  described  by  a  right  coprime 
fractional  representation  p~nrd~K  in  {G,H,I,J).  The 

satisfies  the  Ore  condition  for  right  fractional  representa¬ 
tions  if.  whenever  *eC  admits  a  left  fractional  representation  it  also 
admits  a  right  fractional  representation  and  vice  vena.1 
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Fig.  2.  Unity  gain  negative  feedback  system. 


Fig.  3.  Feedback  system  with  plant  and  compensator. 


closed-loop  dynamics  of  2,  are  described  by  the  maps 

u~e ;  h„-(l+p)-'-d,(dr  +  n,y'  (3.1) 

-*>  :  hyv^pil+pV'^n'id'  +  n,)''.  (3.2) 

Note  that 

+  (3-3) 

We  say  that  2.p  is  well  defined  in  G,  (H,  respectively),  if 
i^eC,  ( H ,  respectively). 

Note  that  the  pairs  (nr,dr  +  nr)  and  (dr,  dr  +  nr)  are  right 
coprime;  indeed,  the  right  coprimeness  of  («,,*/,)  implies 

(2.4) ,  hence 

(u,-cr)n,  +  e,(d,+  /t,)-l  (3.4) 

while 

( vr  -  ur)dr  +  u,(d,  +  nr)~\.  (3.5) 

Theorem  1:  Consider  the  feedback  system  of  Fig.  2. 

a)  Let  p  1  be  a  fractional  representation  in 

( G,H,1,J )  of  the  element  p€G;  then  7.p  is  well  defined  in 
G  if  and  only  if  dr  +  nr  £  /. 

b)  Let  p  -  ndf 1  be  a  right  coprime  fractional  repre¬ 
sentation  in  {G,H,I,J}  of  the  element  p£G;  then  2^  is 
well  defined  in  H  if  and  only  if  dr  +  nrSJ. 

Proof:  a)  =>.  hn£G  and  dr£l  imply 

dr  'h„-dr- '(1  +p)~'  -  df  'd&d,  +  nr) 1  -  (d,  +  n,y " 1 6  <7. 

(3-6) 

Now  drGIcH  and  n,£H ,  so  d,  +  nr£H.  This  together 
with  (3.6)  implies  d,  +  nr£  I. 

a)  «*.  d,  +  nr£l  implies  (dr  +  n,)  ~ 1  €  G;  hence  — 
d,{d,  +  nr)~ 1  €  G. 

b)  Follows  from  Property  3,  together  with  (3.4)  and 

(3.5) .  ■ 

Of  course,  a  similar  theorem  holds  for  left  factoriza¬ 
tions. 

We  now  consider  the  feedback  system  2  of  Fig.  3  where 
the  plant  p  is  preceded  by  a  compensator  c;  p  and  c 
belong  to  G  and  are  specified  by  their  coprime  fractional 
representation  in  { G,H,1,J }  nrdf 1  and  yf  lx„  respec¬ 
tively. 


To  describe  the  feedback  system  2  we  consider  the  map 
hn: ( “e  “*)•“*( ei> *2)-  Simple  calculations  give 


“ 

(1+pc)  1 

-p(l+cp)~' 

c(l  +pc)~' 

(1  +  cp)~' 

(3.7) 

Now  let  f^,:(«),Mi)'-*(>'i,>’i).  Using  the  summing  node 
equations  it  is  easy  to  see  that 

\.-*(A„-l)  and  h„-\  -Kh,u  (3.8) 


where  K  is  the  symolectic  matrix 


, r  r  0  1 
[-1  oj- 

(3.9) 

It  is  well  known  that  in  the  case  of  multivariable  rational 
matrices,  one  has  to  consider  the  four  submatrices  of 
in  (3.8)  because  examples  show  that  any  one  of  the 
submatrices  may  be  unstable  while  the  remaining  ones  are 
stable.  (For  detailed  examples,  see  [30].)  Let  us  calculate 

Vm.-U  +pc)~'=‘\  ~pc{\  +pc)_1 

-l-p(l+cp)"‘c 
-  1  ~P[  yf  \y,dt  +  x,nr)df '  ]  ‘  'c 
-1  -nr(y,dr  +  x,nr)~'x, 

(3.10) 

ACj»,-cO  +pc)~'-(l+cp)~'c 

mdr(ytP,-ixtn,)~‘xl 

(3.H) 

“  ( 1  +  cp)~ '  “  ( 1  +yf  'x,nrdf ')  ■ ' 

~[yf'(y,dr+x,nr)df'y' 

“<(M +*/«.•)' Vl 

(3.12) 

-  ~ P(  1  +  cp) " 1  -  -  n\y,dt  +  x,nr) '  ly,. 

(3.13) 

We  say  that  2  is  well  defined  in  G,  ( H .  respectively)  if  and 
only  if  each  entry  of  h„  defined  in  (3.8)  belongs  to  G,  (H, 
respectively). 

Theorem  2:  Consider  the  feedback  system  2  of  Fig.  3. 
Let  nrdf'  and  yf  'xt  be  a  right  and  left  fractional  repre¬ 
sentations  of  p  and  c  in  {G,H,I,J}. 

a)  If  y,dr  +  x,nr  £  /,  then  2  is  well  defined  in  G. 

b)  If y,dr  +  x,nr£J,  then  2  is  will  defined  in  H. 

c)  If  htidx  £  G,  then  y,dr  +  x,nr  £  /  hence  if  2  is  well 
defined  in  G,  then  y,dr  +  x,nt  £  I. 

d)  Assume,  in  addition,  that  nr(y,dr)~ 1  and  (y,dr)~  *x, 
are  right  coprime  and  left  coprime  fractional  representa¬ 
tion,  respectively;  then  A,)»i  £  H  implies  that  y,dr  +  x,nr  £ 
J,  and  hence,  if  2  is  well  defined  in  H,  then  y,dr  +  xtnr£.J . 

Proof:  a)  and  b).  If  y,dr  +  x,nr  £  /,  ( J ,  respectively), 
then  by  the  definition  (2.1)  of  /,  1(2.2)  of  J,  respectively), 
the  formulas  (3.10)-(3.I3),  and  the  closure  of  the  ring  G, 
( H ,  respectively),  the  conclusion  follows. 
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c)  W  httmj  e  C,  then  so  is  dr  'h i^yf 1  since  dr  E 1  and 
y,&I.  Now, 

4"  \^yr 1  l  +  cp) '  V 1 

-  '( i +>r  ') "  V 

■  4" '  [  '(M  +  ']>•/''- (>■/<  +  X,nr) ' 1 

(3.14) 

hence  the  fact  that  ht^eG  implies  that  (y,dr  +  x,nr)~ 1 6 
G  and  thus  (y,dr  +  x,nr)  e  1. 

d)  First  we  prove  that  the  pair  (nr,y,dr  +  x,nr)  is  right 
coprime.  Since  (nr,y,dr)  is  right  coprime,  there  exists  i?, 
and  ti,  S  H  such  that 

I:  (315) 

hence 

(“,  ~  o,x,)n,  +  vr(y,dr  +  x,nr)  - 1  (3.16) 


coprime  and  left  coprime  respectively,  then  c  is  given  by 
expression  (4.1). 

Proof: 

Step  1:  Choose  any  keJ ,  (hence  k~‘eH),  and 
solve  for  y,  and  x,e  H  the  equation 

y,dr  +  x,nr  =  k.  (4.3) 

Observe  that  if  (y,,x,)  is  any  solution  in  H  of  (4.3),  then 
*  ~'(y,dr)  +  k  ~'(x, /i,)-l  (4.4) 

and 

(M)*’1 +  (*/«,)*■'- 1.  (4-5) 

hence,  ( nr,y,dr )  is  right  coprime  and  (y,dr,x,)  is  left 
coprime.  Thus,  the  assumptions  of  Theorem  2,  part  d) 
holds  for  any  solution  of  (4.3). 

Step  2:  Obtain  all  solutions  of  the  homogeneous 
equation 


and  the  claim  is  established.  Similarly,  we  show  that  y?dr  +  x,\  =  0.  (4.6) 

(y,d, +  *,/»,,  x()  is  left  coprime.  Now  consider 

Since  p  -  nrdr  —  d,~  'n,,  direct  calculation  shows  that  for 
A,*,-* -«,(M  +  Jt,«,)_,Jt,.  (3.17)  any  rSH, 


By  assumption,  ht  lli  €  H\  then  the  special  assumption  of 
d)  and  Property  4  imply  that  y,dr  +  x,nrGJ.  This  com¬ 
pletes  the  proof.  ■ 

Note,  the  special  assumptions  used  in  d)  to  the  effect 
that  nr(yid,)~'  is  right  coprime  and  (y,dr)~'x,  is  left 
coprime,  imply,  in  some  sense,  that  p  and  c  have  no 
common  factors.  More  precisely,  since  J  serves  as  the 
group  of  units  in  our  theory  these  conditions  imply  that 
any  common  factors  of  p  and  c  must  lie  in  J. 


yf m  m,  x*  =  -  rd,  (4.7) 

are  solutions  of  (4.6). 

It  remains  to  show  that  all  solutions  of  (4.6)  are  of  the 
form  (4.7);  so  we  assume  that  y*  and  x*  e  H  and  satisfy 
(4.6).  Let  r—  —xj,d,~x\  hence 

x,h~rd,.  (4.8) 

Now  using  (4.6) 


IV.  Design 

Consistent  with  our  approach  of  matching  the  plant 
model  to  the  goal  of  the  given  feedback  system  design 
problem  the  present  section  is  devoted  to  the  problem  of 
characterizing  the  set  of  compensators  which  will  “place" 
a  feedback  system  in  a  prescribed  ring  H  given  that  both 
the  plant  and  compensator  are  modeled  by  fractional 
representations  in  {G,H,J,J,}- 
Theorem  3:  For  the  feedback  system  2  of  Fig.  3,  let  the 
plant  p  have  a  right  coprime  and  a  left  coprime  fractional 
representation p - nrd~ 1 - d,~ 'n,  in  {G,H,I,J}.  Let  ur  and 
c,  both  in  H  be  such  that  (2.4)  holds.  Then  for  any 
such  that  tv^-f  o,e/,  the  compensator 

c“(wn/  +  o,)”1(- wd,+ u,)€  C  (4.1) 

results  in  a  feedback  system  2  well  defined  in  H.  For  such 
a  compensator,  hn£H2*2  and 

h  m\l~n^~wdt*"r)  - «,(*«»/  + »,)  ,  . 

dr(~  wd,  +•  ur)  dr(wn,  + «?,)  ' 

Conversely,  if  2  is  well  defined  in  H  and  if  the  compensa¬ 
tor  c  - yf  'x,  is  such  that  (n,,y,dr)  and  {y,dr,xt)  are  right 


y!‘-yll'd,d,-'‘-xl\d,-'--xfr 

-  -  x,kd,~  'n, »  rn,.  (4.9) 

Equations  (4.8)  and  (4.9)  show  that  any  solution  of  (4.6) 
has  the  form  of  (4.7);  it  remains,  however,  to  show  that 
rSH, 

r  -  -  xfd,-  1  -  -  xfa- '(d,v,  +  n,u,) 

»  -  x,hv,  -  xkd,~ 1 n,u , »  -  xkv,  +y!'u,  S  H.  (4. 10) 

Step  3:  Obtain  a  particular  solution  of  (4.3).  From 
the  right  coprimeness  condition  for  ( nr,dr ), 

kvrdr  +  kurnr»  k  (4.11) 

hence 

yr-kv„  xf~kur.  (4.12) 

Hence  any  solution  of  (4.3)  is  of  the  form 
y,~m,  +  kvr 

x, »  —  rd,  +  ku,  for  some  re  H  (4.13) 

and  for  any  such  solution  (nr,y,dr)  is  right  coprime  and 
(y,dr,  x,)  is  left  coprime. 
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Step  4:  Consider  the  condition 
r&H&ndk&J  such  that  rn,+  kvrE  1  (4.14) 

or  equivalently,  if  we  set  w  —  k  ~  V  e  H, 

w  £  //  such  that  wn,  +  c,  £  /,  (4. 1 5) 

If  (4.15)  holds, 

c  ”  (hv»,  +  vr)  ~ —  wdt  +  ur)  £  G  (4.16) 

is  a  compensator  in  G  which  can  also  be  written  as  [see 
(4.13)] 

C“{rn,  +  kvry\-rd,  +  kur).  (4.17) 

If  we  let  y,  —  rn,  +  kv,  and  x, «  —rd,  +  kuf,  then,  by  (4.17), 
c—yf'x  and,  by  calculation,  we  verify  that  (4.3)  holds. 
Thus  for  any  such  compensator,  by  Theorem  2,  the  feed¬ 
back  system  2  is  well  defined  in  H. 

Step  5:  Conversely  consider  a  feedback  system 
well  defined  in  H  with  a  compensator  c^-yf'x,  such  that 
(n„y,dr)  and  (y,dr,x,)  are  right  coprime  and  left  coprime, 
respectively.  By  Theorem  2,  (4.3)  holds  for  some  k  SJ, 
hence  by  the  analysis  above,  c  is  also  given  by  (4.1)  for 
some  wGH  such  that  wn,  +  vrGl.  The  proof  is  thus  com¬ 
plete.  ■ 

The  theorem  yields  a  complete  parameterization  of  all 
possible  controllers  which  will  place  a  plant  in  H  given  the 
existence  of: 

1)  right  and  left  coprime  fractional  representations  of  p 
and 

2)  a  w  in  H  for  which  (wn,  +  vr )  is  in  /. 

In  the  multivariable  case  where  p  is  a  square  matrix 
whose  elements  arc  proper  rational  functions  it  is  well 
known  that  p  has  left  and  right  coprime  fractional  repre¬ 
sentations  [19J.  In  order  to  obtain  a  proper  controller  one 
has  to  choose  w  in  (4.1)  so  that  det(w(j)n,(j)  +  tir(j)]^0  at 
infinity.  Methods  for  obtaining  such  a  proper  stabilizing 
controller  have  been  reported  in  [32]  and  [33],  Alterna¬ 
tively,  one  can  verify  the  existence  of  such  a  w  in  our 
algebraic  setting  by  invoking  the  fact  that  n,  and  d,  are 
right  coprime  and  applying  linear  algebraic  arguments 
thereto.  Of  course,  these  arguments  apply  to  distributed 
systems  as  well  as  lumped  systems  using  the  formulation 
of  [7]  and  [8], 

In  the  most  genera]  ring  theoretic  setting  neither  right 
nor  left  coprime  fractional  representations  of  p,  nor  a  w 
such  that  (wfi  +  o,)  is  in  /,  are  assured  to  exist.  At  present, 
the  only  known  counterexample  to  the  latter  is,  however, 
in  the  ring  of  integers  which  is  of  no  system  theoretic 
interest. 

Conditions  1)  and  2)  have  been  conjectured  to  be  both 
necessary  and  sufficient  conditions  for  the  existence  of  a 
compensator,  c,  which  places  the  feedback  system  in  H 
[3].  In  fact,  if  c  places  the  feedback  system  in  H,  then 
from  (3.7)  we  obtain  left  and  right  fractional  representa¬ 
tions 


P -(■ -  ' '  -  (*♦,.,)"(  -  (41g) 
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Note  that  there  is  no  guarantee  that  these  fractional 
representations  are  coprime.  These  representations  are. 
however,  coprime  when  the  compensator  is  in  H.  Indeed, 
in  that  case  they  satisfy  a  stronger  condition  which  com¬ 
pletely  characterizes  those  plants  which  can  be  placed  in 
H  by  a  compensator  in  H.  For  an  early  analogous  result, 
see  [10,  pp.  85-87], 

Corollary  1:  For  the  feedback  system  2  of  Fig.  3  there 
exists  a  c  in  H  which  places  the  feedback  system  in  H  if 
and  only  if  p  admits  left  and  right  fractional  representa¬ 
tions  p“  d)-1/!,—  nrd~'  such  that  n,  is  a  right  factor  of 
1  -  dr  and  n,  is  a  left  factor  of  1  —  d,. 

Proof:  If  the  feedback  system  is  placed  in  H  by  a  c  in 
H  it  admits  the  fractional  representations  of  (4.18).  By 
calculation  [see  (3.7)] 


(4.19) 

-/W“1 

(4.20) 

which  verifies  their  coprimeness  since  c  is  in  H.  Moreover, 
upon  rearranging  the  terms  in  (4.19)  and  (4.20)  the  condi¬ 
tions  of  the  corollary  follow.  Conversely,  if  fractional 
representations  exist  which  satisfy  the  conditions  of  the 
corollary  there  exists  ur  in  H  such  that 

ur"r-dr- 1  (4.21) 

(equivalently  p  =  nrd~ 1  is  a  right  coprime  fractional  repre¬ 
sentation  with  1).  Now,  by  using  this  right  fractional 
representation  in  (4.1)  (with  any  left  coprime  fractional 
representation)  and  w-0  we  obtain  a  compensator  C«u, 
in  H,  which  places  the  feedback  system  in  H.  ■ 

V.  Examples 


Example  1:  A  Single  Variate  Servomechanism  Problem 4 


Here  G  is  the  ring  of  proper  rational  functions  and  H  is 
subring  of  functions  analytic  in  Res>  -1.  Consider  the 
problem  of  designing  a  compensator  for  the  unstable 
plant  p(s)»(s  +  l)/(s2 -4)  which  will  simultaneously 
place  the  poles  of  the  feedback  system  in  the  region, 
Re(j)<  -  1,  and  cause  the  system  to  asymptotically  track 
a  step  input.  Since  our  transfer  functions  are  commutative 
we  may  adopt  common  right  and  left  fractional  repre¬ 
sentation  for  p(s).  In  particular. 


P(*)m 


(j+0 

(s2-4) 


(J+1) 

(*-2)1 

(*  +  2)2. 

[(*  +  2)J 

while 


n(s)d(s)~' 

(5.1) 


16  ' 

(j+1) 

+ 

(*  +  2/3) 

(*-2) 

3 

>  +  2)V 

(*  +  2) 

[(*  +  2)] 

-u(r)n(s)  +  c(s)d(s)-l.  (5.2) 


*The  purpose  of  this  example  is  merely  to  five  t  simple  iOustntioo  of 
the  theory.  In  this  situation,  a  much  more  hiahJy  developed  theory  is 
available  in  (29). 
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Here,  each  of  the  four  rational  functions,  n(s),  d(s),  u(s), 
and  0(5),  lie  in  the  ring  of  operators  with  poles  in  the 
region  Re(j)  <  —  1  and  hence  the  set  of  all  compensators 
which  will  place  the  feedback  system  in  this  ring  is  given 
by  Theorem  3  with  w(j)  also  in  the  ring.  Moreover,  for  an 
arbitrary  w(s)  the  input-output  mapping  for  the  resultant 
feedback  system  will  take  the  form 


WJ)*- 


f(s+l)(s-2)l 

w(s)  + 

'  16(5+1) 

(s+2)3 

3(5 +  2)2 

-  n(5)d(r)w(i)  +  n(s)u(s). 


(5.3) 


By  the  final  value  theorem  the  feedback  system  will 
asymptotically  track  a  step  input  if  and  only  if  6^(0)  - 1 
(equivalently  c(s)  has  a  pole  at  zero).  As  such,  to  simulta¬ 
neously  place  the  poles  of  the  feedback  system  in  the 
region,  Re(s)<  —  1,  and  cause  the  feedback  system  to 
asymptotically  track  a  step  input  we  must  find  a  w(s)  with 
poles  in  this  region  such  that  (0)*1.  Evaluating  (5.3) 
at  s  —  O  and  setting  it  equal  to  one  yields 


W°>-?"(o>+5-i* 


(5.4) 


implying  that  w(0)— — 4/3.  As  such,  the  simplest  w(s) 
which  will  achieve  our  simultaneous  goals  is  the  constant 
h>(5)“  -4/3  whose  poles  are  trivially  in  the  prescribed 
region.  Adopting  this  w(s),  a  little  algebra  with  the  expres¬ 
sions  of  Theorem  3  will  reveal  that  die  required  com¬ 
pensator  takes  the  form 


c(s)" 


(20s  +  24)(s  +  2) 


(5.5) 


(3s  +  4)s 

while  the  input-output  mapping  for  the  feedback  system 
takes  the  form 


Since  the  previous  compensator  design  was  achieved 
with  an  especially  simple  w(5)  let  us  add  an  additional 
constraint  to  the  problem  by  requiring  that  (s)  have 
zeros  at  ±j  (so  that  the  system  will  be  insensitive  to  a 
noise  source  at  that  frequency).  Now,  from  (5.4)  it  follows 
that  the  above  design  is  the  only  compensator  which  will 
make  (0)  —  1  with  a  constant  w(5);  hence  to  satisfy  this 
additional  design  constraint  we  will  work  with  the  first 
order  w(5)  in  the  form 


w(s)~ 


as  —  4 
bs  +  3  ' 


(5.7) 


Here,  by  specifying  the  zeroth-order  coefficients  of  w(s) 
we  assure  that  w(0)= -4/3  while  we  are  left  with  the 
parameters  a  and  b  to  create  the  required  zeros.  Of  course, 
to  achieve  our  stability  condition  we  must  have  —3 /b< 
—  1 .  Substituting  the  w(s)  of  (5.7)  into  (5.3)  yields 

(s  + 1 )  [  ( 1 66  -  3  a)s*  +  (60  +  6  a  +  326)5  +  72  ] 

3(5  +  2)3(6s  +  3) 

(5.8) 


W')- 


To  obtain  the  desired  zeros  at  s  —  ±j  the  equation 
[  ( 166  -  3a)52  +  (60+  6a  +  326)5  +  72  ]  -  fc[  s2  +  1  ] 

(5.9) 


must  be  satisfied.  Now,  this  represents  three  linear  equa¬ 
tions  in  three  unknowns  and  has  the  unique  solution 


a  —  —  17,  6  —  72+  and  k  —  72.  (5.10) 

lo 

Moreover,  -3/6—  — 16/7  <  —  1;  hence  this  choice  of 
w(s)  will  also  assure  the  prescribed  degree  of  stabilization. 
As  such,  we  take 


\ 


a“i 


(j+1)(20j  +  24) 
3(5 +  2)3 


(5.6) 


-(175  +  4)  _  -(2725  +  64) 

(215/16  +  3)  "  (215  +  48) 


(5-11) 


Gearly,  c(s)  has  the  required  pole  at  zero  (for  6^(0)—  1), 
although  it  is  by  no  means  obvious  that  this  quasi-stable 
compensator  will  transfer  the  unstable  poles  of  p(s)  to  the 
prescribed  region.  Indeed,  this  illustrates  the  underlying 
power  of  the  proposed  design  technique  in  that  when  one 
designs  the  system  in  terms  of  w(r)  rather  than  c(s)  the 
pole  placement  or  stabilization  process  is  automatically 
resolved  by  working  with  a  w(s)  whose  poles  lie  in  the 
prescribed  region  while  the  remainder  of  the  design  pro¬ 
cess  is  simplified  by  the  affine  relationship  between  w(s) 
and  the  matrices  hn  and  h^.  Finally,  we  note  that  c(s)  has 
a  zero  at  5  —  —  2  which  may  cancel  with  the  pole  of  p(s)  at 
5  —  -  2.  This,  however,  does  not  contradict  the  coprime- 
ness  assumptions  of  Theorem  3  since  the  common  factors 
involved  lie  in  J  which  serves  as  the  group  of  units  in  our 
theory.  Fortunately,  such  common  factors  can  never  lead 
to  an  erroneous  design  since  by  assumption  the  poles  and 
zeros  of  the  rational  functions  in  J  lie  in  the  prescribed 
region.  As  such,  any  cancellations  which  may  take  place 
are  benign. 


which  yields 

128(s  +  2)(s3+  1) 

(7s2 -56s -60)5 
and 

u  (A  384(5+ 1)(52+1) 

(s  +  2)3(21s  +48) 

satisfying  all  of  our  design  criteria. 

Example  2:  A  Multivariate  Lumped-Distributed 
Decoupling  Problem 


(5.12) 


(5.13) 


Consider  the  multivariate,  lumped-distributed  plant 


16 


p(s)- 


e~l/' 

(5+1) 

0 


(5-1) 

(5+1) 

1 

(5-1) 


(5.14) 
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which  we  desire  to  stabilize  and  simultaneously  decouple 
by  feedback.  For  most  lumped-distributed  systems  one 
can  take  H  to  be  a  ring  of  matrices  whose  elements  lie  in 
the  algebra  <i_  (o0)  of  stable  transfer  functions  generated 
by  lumped  elements  and  delays  while  G  is  a  ring  of 
matrices  whose  elements  lie  in  9>(a0),  the  algebra  of 
quotients  of  elements  in  (2_(o0),  as  per  Table  I.  In  our 
case,  however,  although  e_,/'  is  /^-stable  (since  it  is 
analytic  on  the  right  half-plane  and  bounded  on  the 
imaginary  axis  [10])  it  has  a  “nasty”  singularity  at  r«»0 
and  hence  does  not  lie  in  &(o0)  for  any  o0  <  0.  As  such,  we 
take  H  to  be  a  ring  of  2x2  matrices  whose  elements  are 
transfer  functions  lying  in  the  Hardy  space  H  m(R)  of 
functions  which  are  (essentially)  bounded  on  the  ju  axis 
and  admit  an  analytic  extension  into  the  right  half-plane 
(thereby  making  them  L2- stable)  [12].  Similarly,  we  let  G 
be  a  ring  of  2x2  matrices  whose  entries  are  transfer 
functions  lying  in  the  Lebesgue  space  L^iR)  [12].  With 
this  setup  1  becomes  the  set  of  H w  functions  which  are 
uniformly  bounded  below  on  the  ju  axis  while  J  is  the  set 
of  H —  functions  whose  analytic  extension  is  uniformly 
bounded  below  in  the  right  half-plane  [12].  Equivalently,  J 
is  the  set  of  invertible  outer  functions  in  HX(R)  [12]. 

Using  these  spaces  a  little  algebra  will  reveal  that  p(s) 
has  the  right  and  left  coprime  fractional  representations  in 
{G,H,I,J}  shown  below: 


e-'" 

(J+U 


(*-»)* 

(s+1)2 

1 

(s-H) 


(j-Q 

(j+D 


'^KW1 


o 

(s+l) 

•d'(s)~'n,(s) 


e~l/l  (r-1) 
(j+1)  (s+1) 

0  — 5 — 

(s+1) 


*-•/»  (j-ir 

0  0  t — rr  —  -4  i  o  l 

(*+•)  (r+i)2  + 

02  o  7-J—  o  l  o 

.1  (j+i)  J  [ 

-u,(j)n,(j)  +  cr(j)^(j)- 


(J-1) 
(s  +  1) 


Upon  substitution  of  these  matrices  into  the  expression 
for  h/]U|(s)  from  Theorem  3  one  obtains 


e'l/r*  (r-1)2 

__  (•*+!)  (j+1)2 

°  (*+t) 


(J-1) 

(r+1) 


wll(*) 

«'ij(1) 

wji(j) 

2(s-ir 

(s+I)2 

2 

(s+1) 


which  will  be  stable  if  and  only  if  the  w^s)  are  stable. 
Now,  to  decouple  the  system  we  require  that 

(5'20) 


W' 


(s+1) 


Clearly,  w21(s)»0  solves  (5.21).  On  the  other  hand  (5.20) 
has  numerous  solutions  none  of  which  are,  however,  sta¬ 
ble.  As  such,  the  system  cannot  be  decoupled  and  stabi¬ 
lized  simultaneously.  Note,  since  our  theory  guarantees 
that  all  stable  feedback  systems  with  plant  p(s)  take  the 
form  of  (5.19)  if  we  cannot  find  stable  w’s  which  decouple 
(5.19)  we  are  assured  that  it  is  impossible  to  simultaneously 
stabilize  and  decouple  p(s)  by  feedback  (using  a  com¬ 
pensator  as  specified  in  Theorem  3)  and  we  need  not 
consider  other  formulations. 

Since  we  cannot  simultaneously  stablize  and  decouple 
p(j)  by  feedback  the  best  we  can  do  is  to  try  to  stabilize 
p(s)  while  preserving  its  triangularity  (which  will  allow  us 
to  sequentially  adjust  its  various  outputs).  Formally,  this 
can  be  achieved  by  taking  w(j)  — 0  which  yields  the  in¬ 
put-output  mapping 

'o  ^4 

w*)-  (5*1)2  •  f5-22) 

0  (7+1) 


Unfortunately,  the  first  input  has  been  rendered  useless 
by  this  compensator  and  hence  the  goal  of  being  able  to 
sequentially  tune  the  outputs  is  not  achieved.  On  the  other 
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hand,  if  we  take 


then 


w(s)~ 


1 

0 


0 

0 


e-'/' 

(*+D 

0 


2(s~\)2 

(s+l)2 

2 

(5+1) 


(5-23) 


(5.24) 


which  has  the  desired  property  is  obtained.  In  particular, 
one  can  tune  the  second  input  to  control  the  second 
output  and  then  adjust  the  first  input  to  simultaneously 
cancel  out  the  effects  of  the  second  input  on  the  first 
output  and  control  the  first  output.  Of  course,  since  w(s) 
is  stable  so  is  (j). 

Finally,  we  note  that  as  we  have  formulated  our  theory 
one  can  deal  only  with  square  matrices  (since  rectangular 
matrices  are  not  closed  under  multiplication).  The  exten¬ 
sion  to  rectangular  matrices  is,  however,  straightforward 
[19]  and  yields  an  identical  theory  the  details  of  which  are 
left  to  the  reader. 


Example  3:  A  Multidimensional  Image  Restoration  Problem 


As  such,  the  set  of  all  possible  FIR  transfer  functions 
which  can  be  obtained  from  p(z,,z 2)  by  feedback  takes 
the  form 


“-[m +2*^2  + *,*2 +  3r,+3r2] 

•*'(*i.*2)_  +  (5.28) 

where  h^z,^  is  an  arbitrary  polynomial  in  two  variables. 
Clearly,  w(r,,z2)  should  be  low  order  to  keep  the  “point- 
spread  function”  of  ^^(zj.Zj)  as  concentrated  as  possi¬ 
ble.  Indeed,  if  we  take  w(zt,z£  —  0  we  obtain 

^,(*i.*2)--  j[*?  +  z,z2]  (5-29) 

in  which  the  response  from  a  given  pixel  effects  only  two 
adjacent  pixels.  Note  that  the  fact  that  these  pixels  are  not 
centered  around  the  input  point  does  not  cause  any  diffi¬ 
culty  since  one  can  always  shift  the  origin  of  the  raster  to 
compensate.  Taking  this  wfz^z-j)  we  obtain  the  simple 
compensator  c(zx,zf)’“  —  z,  which  represents  a  one  direc¬ 
tional  shift  and  a  180°  phase  shift. 

An  alternative  design  which  also  yields  a  “point-spread 
function”  which  affects  only  two  pixels,  although  it  is 
shifted  further  from  the  origin,  is  obtained  with  wfz^Zj)  — 
-(l/9)z,.  This  yields 


Let 


*l  +  *2 

zf  +  z,z2  +  3 


(5.25) 

and 


^Ju1(^i.^)a*|[-r?  +  2/?r2] 


(5.30) 


denote  the  discrete  two-dimensional  transfer  function  for 
a  device  in  a  digital  image  processing  system.  Since  this 
represents  an  IIR  (infinite  impulse  response)  transfer 
function  the  image  processing  device  will  tend  to  “smear” 
the  image  with  the  data  observed  at  any  one  pixel  distort¬ 
ing  all  other  pixels  at  the  output  of  the  device.  In  an  effort 
to  reduce  this  “smearing”  effect  we  would  like  to  place  the 
device  in  a  feedback  system  whose  input-output  transfer 
function  minimizes  the  “smearing”  effect  In  particular, 
that  means  that  the  input-output  mapping  for  the  feed¬ 
back  system  should  have  an  FIR  (finite  impulse  response) 
transfer  function  with  its  “point-spread  function”  con¬ 
centrated  about  a  single  point  as  closely  as  possible. 

Since  the  FIR  transfer  functions  are  just  the  polynomi¬ 
als  we  let  H  be  the  ring  of  polynomials  in  two  variables 
and  <7  be  the  ring  of  rational  functions  in  two  variables 
[16].  Once  again  employing  only  a  single  fractional  repre¬ 
sentation  since  these  rings  are  commutative  we  obtain  the 
coprime  fractional  representation 

f(*i.*2>  *  [  *1  +  '2]  [  *1  +  *1*2  ■ +  3  ] "  ‘ 

-n(z1,z2)<f(z„Z2)_'  (5.26) 

where 

[“  J*«][*.  +  *a]  +  [j][*i  +  *A  +  3] 

-  u(z„Z2)n(zl,z1)  +  o(z,zI)d(z„Zj)  -  1. 

(5-27) 


c(*|.*2)“ 


*l(*l  +  *2> 

zJ  +  z,z2  +  3 


(5.31) 


Since  two- thirds  of  the  output  energy  in  this  design  is 
concentrated  at  a  single  point  whereas  the  energy  is  equ¬ 
ally  divided  in  the  previous  design  it  may  be  argued  that 
this  represents  a  superior  design.  On  the  other  hand,  the 
shift  from  the  origin  is  greater  and  the  compensator  more 
complex  in  this  case.  Finally,  since  all  FIR  transfer  func¬ 
tions  are  stable  (in  an  appropriate  sense)  the  feedback 
systems  obtained  via  either  choice  of  vfzj.zj)  are  stable. 
Moreover,  both  compensators  are,  themselves,  stable  as  is 
Pi*  1.^2)  1*1 


Example  4:  A  Time-Varying  Differential-Delay 
Stochastic  Optimal  Control  Problem 

Consider  the  feedback  system  of  Fig.  4  where  the  plant 
represents  a  cascade  of  a  time-varying  function  /  with  an 
ideal  predictor  e1.  The  system  is  driven  by  a  stochastic 
process  a,  which  is  derived  from  white  noise  by  passing  it 
through  a  miniphase  filter  with  transfer  function  ( s  +  2 )/(s 
+ 1).  We  desire  to  choose  a  compensator  which  will 
stabilize  the  system  and  minimize  the  performance 
measure 


/-£||b||2+£||d||J 


(5.32) 


under  the  constraint  of  stability.  Here,  d  is  the  stochastic 
process  observed  at  the  output  of  the  system,  b  is  the 


desoer  ei  a/,  fffdbaok  system  design 


”1 


Fig.  4.  Stochastic  control  system. 


Fig  5.  Open-loop  optimisation  problem. 


stochastic  process  observed  at  the  plant  input,  and  E  is 
the  expected  value  operator. 

Since  we  have  a  time-varying  component,  a  rational 
component,  and  a  delay  component  we  formulate  our 
theory  in  an  abstract  operator  theoretic  setting  [20]  with  G 
taken  to  be  the  bounded  operators  on  the  Hilbert  space 
L3(R)  and  H  taken  to  be  the  causal  bounded  operators 
(which  correspond  to  the  stable  systems  in  such  a  setting) 
[20],  [23].  Note,  in  this  setting  we  will  denote  the  time-in¬ 
variant  operators  by  their  transfer  function  and  the  time- 
varying  multiplication  operators  by  their  characteristic 
function.  Of  course,  one  must  be  careful  with  such  nota¬ 
tion  since  the  operational  calculus  associated  with  the 
time-invariant  components  is  only  partially  valid  in  such  a 
setting. 

Since  the  inverse  of  a  predictor  is  the  ideal  delay  which 
is  causal  one  immediately  obtains  the  right  and  left 
coprime  fractional  representations  for  p  in  the  form 

(5.33) 

where 

[/-,][/]  +  [0][e-']-M,n,  +  u,4*1  (5.34) 

and 

[1  ][l] +  [«-*/■' ][°]-n,u<  +  </,c,»1-  (5.35) 

Here,  we  have  assumed  that  /”'  exists  and  is  bounded 
(i.e.,  /  is  bounded  away  from  zero)  while  /  and  /“'  are 
both  causal  since  multiplication  by  a  function  of  time  is  a 
memoryless  operation  [20],  From  Theorem  3  it  now 
follows  that  the  input-output  and  input-plant  input  map¬ 
pings  for  our  feedback  system  with  compensator  defined 
by  a  causal  operator  w  will  take  the  form 

(536) 

and 

(5-37) 

As  such,  our  optimization  problem  reduces  to  choosing 
the  causal  w  which  minimizes  the  performance  measure  of 

t5  3TS  wher#  rl **  U  n  anH  fi »  U  n  ^19 


It  is  significant  to  note  that  even  though  we  are  inter¬ 
ested  in  designing  an  optimal  closed-loop  system  by  mini¬ 
mizing  over  the  operator  w  rather  than  the  compensator 
we  have  transformed  the  problem  into  the  open-loop 
optimization  problem  of  Fig.  5. 

Here  we  desire  to  minimize  J  —  E\\e\\2  over  all  causal 
operators  w,  where  g,,  g2,  and  g3  are  arbitrarily  specified 
bounded  operators.  In  our  case  we  take 


*i 


8i‘ 


-] 


(5.38) 


(5.39) 


and 


-[/] 


(5.40) 


in  which  case  the  output  of  the  open-loop  system  is 
e  « (d,  b)  in  the  product  space  constructed  from  two  copies 
of  the  (Hilbert)  space  on  which  the  given  system  is  de¬ 
fined.  Now,  if  we  take  the  a  in  our  open-loop  problem  to 
coincide  with  the  given  a  in  the  closed-loop  optimization 
problem  then  the  Pythogorean  law  (in  Hilbert  space) 
implies  that 


£l|e|| 


'£||rf||I  +  e||&ll2 


(5.41) 


As  such,  our  two  optimization  problems  coincide. 

Interestingly,  an  explicit  solution  has  recently  been 
given  for  the  above  open-loop  optimization  problem  [9]. 
Indeed,  the  optimal  causal  w  is  given  by 

h-o  -  x  - 1  [  A*  -  'g;g2QX9'  *  V 1  (5-42> 

where  X  and  9  are  causal,  causally  invertible  operators 
such  that 


A’A-gjfgj  w-g,G.*r. 


(5.43) 


Q,  is  the  covariance  for  the  stochastic  processes  a,[  ]c 
denotes  the  causal  part  of  an  operator,  and  denotes 
the  adjoint  operator.  To  apply  this  general  theory  to  our 
example  we  represent  the  adjoint  operation  when  applied 
to  a  transfer  function  by  g(*)*”g(  —  s)  which  coincides 
with  the  classical  adjoint  on  the  ju  axis.  Of  course,  the 
memoryless  multiplication  operators,  [/]  and  [/“'],  are 
self  adjoint.  Finally,  since  a  is  the  stochastic  process 
generated  from  white  noise  by  passing  it  through  the  filter 
(s  +  2)/(s+l) 


Q.~ 


[(*  +  2)1 

[(*  +  2)1 

[(*+1) 

[(*+!). 

(i  +  2)(i-2) 

(j+IX*-l)' 


(5-44) 


First,  we  calculate  X  and  9  via 

A*A~[  ~f\  -«*][ (5.45) 
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and 


W-[e-‘)[r'} 


(5  +  2)(s  -  2) 
(s+  l)(s-l) 

(s  +  2)(s-2) 

(s+IXs-l) 


[r'][*'] 


Taking  the  inverse  Laplace  transform  we  obtain  the  im¬ 
pulse  response  of  this  system  in  the  form 


g(0-5(/+D+e<,’l,^(/+l) 


(5.51) 


,r  T-n  (s+2)(s-2)  r  m 


(5.46) 


Here /_,(r)— /(r  —  1)  and  we  have  used  the  properties  of 
the  delay  and  predictor  to  obtain  the  equalities  '] 

“{/■Ti'Ie-1]  and  (/“'Je']  —  Of  course,  the  ex¬ 

ponential  transfer  functions  commute  with  the  rational 
transfer  functions  allowing  the  cancellation  of  the  ex¬ 
ponential  terms  in  (5.46).  From  (5.45)  and  (5.46)  one  may 
now  readily  obtain  the  required  causal,  causally  invertible 
X  and  9  operators  in  the  form 


where  £  is  the  Dirac  delta  function  and  U  is  the  unit  step 
function.  Now,  the  causal  part  of  g(t)  is  obtained  by 
setting  g(t)  to  zero  for  i  less  than  zero;  hence 

[  S(0]c-  g(0  U(t)  -  eu*l)U{t)  ~-e€-U(t)  (5.52) 
or  equivalently 
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[s(*)]c  = 
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(5-53) 


Multiplying  through  by  the  memoryless  factor  from  (5.49) 
we  then  obtain 


X-A*-V/2+l  and  X-'-X*-1’ 
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while 


and  finally 
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term  in  the  bracket,  i.e.. 
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which  is  surprisingly  simple  given  the  complexity  of  the 
derivation. 

Substituting  the  expression  of  (5.55)  into  the  formula  of 
Theorem  3  now  yields  an  expression  for  our  optimal 
compensator  and  the  input-output  mapping  for  the  re¬ 
sultant  feedback  system  in  the  form 


[/+/-] 


(4  +  2)(4-2) 
(4+l)(4-l) 
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Note  that  h ^  is  stable,  as  required,  even  though  both  p 

and  c  are  unstable. 


VI.  Nonunear  Feedback  Systems 


whose  causal  part  must  now  be  computed.  Recalling  that 
the  memoryless  term  factors  through  the  causal  part 
bracket  [9]  it  suffices  to  compute  the  causal  part  of  the 
time-invariant  system  with  transfer  function 


*(4) 


(4  +  2)., 
(4+1) 


(5.50) 


From  an  algebraic  point  of  view  the  fundamental  dif¬ 
ference  between  linear  and  nonlinear  systems  is  the  fact 
that  nonlinear  systems  fail  to  satisfy  the  right-distributive 
property,  x(y  +  z)  —  xy  +  xz.  They  do,  however,  satisfy  all 
of  the  other  axioms  for  a  ring  with  identity  including  the 
left-distributive  property  (y  +  z)x—yx  +  zx.  As  such,  one 
can  attempt  to  extend  the  preceding  development  to  non- 
20 
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linear  systems  by  carry  ing  it  out  in  left-disinbutive  nngs, 
G  and  H  (23].  Indeed,  if  we  define  a  nght  coprtme 
fractional  representation  for  a  system  g  in  a  left-distribu¬ 
tive  nng  G  relative  to  ( G.H.l.J )  precisely  as  we  did  in 
Section  11  the  fundamental  properties  1,  2,  and  3  go 
through  without  modification. 

Property  IN:  Let  g  -  nrd~ 1  be  a  right  coprime  frac¬ 
tional  representation  of  g  in  { G.H.l.J }  where  G  and  H 
are  left-distributive  rings  with  identity.  Let  nr  and  dt  have 
a  common  right  factor  re//,  i.e.,  n,**x,r,  d,—y,r  for 
some  x,EH  and y,EH.  Then  r  has  a  left  inverse  in  H. 

Property  2N:  Let  g  =*  nrd~ 1  be  a  right  coprime  frac¬ 
tional  representation  of  g  in  { G.H.l.J }  where  G  and  H 
are  left-distributive  rings  with  identity.  Let  g~xry~'  be  a 
second  (not  necessarily  coprime)  right  fractional  repre¬ 
sentation  of  g  in  {G.H.l.J };  then  there  exists  r  in  H  such 
that 

x,-n,r  and  yr**d,r.  (6.1) 

Property  3N:  Let  g  =  nrd~ '  with  nrEH  and  dr  El 
where  G  and  H  are  left-distributive  rings  with  identity. 

a)  If  drEJ ,  then  gEH. 

b)  I fg-nrdr"  is  a  right  coprime  fractional  representa¬ 
tion  of  g  in  { G.H.l.J },  then  gEH  implies  drEJ. 

With  the  aid  of  property  3N  one  can  do  a  complete 
analysis  of  a  nonlinear  feedback  system  h^=p(  1  +p)~'  * 
n,d~'  where  nrd~ 1  is  a  right  coprime  fractional  repre¬ 
sentation  of  h>u.  Indeed,  ^  is  well  defined  in  <7  if  and 
only  if  d.EJ  and  it  is  well  defined  in  H  if  and  only  if 
dr  EJ.  Note,  however,  that  we  cannot  construct  our  frac¬ 
tional  representation  for  hyu  from  a  fractional  representa¬ 
tion  for  p  since  the  verification  that  such  a  representation 
is  copnme  appears  to  require  right-distributivity  [see  (3.4) 
and  (3.5)]. 

The  right  coprime  fractional  representation  plays  a  spe¬ 
cial  role  in  the  nonlinear  case  because  kyu’“p(\+p)~’ 
holds,  whereas  hyu  =**(!  +p)~  'p  does  not  (even  though  the 
latter  formula  is  true  for  the  linear  case).  As  such,  those 
results  on  the  analysis  of  feedback  systems  which  assume 
a  left  coprime  fractional  representation  theory  fail  as  does 
the  design  theorem  since  it  simultaneously  employs  both 
left  and  right  coprirae  fractional  representations.  We  be¬ 
lieve,  however,  that  these  results  should  hold,  at  least  in 
part,  for  nonlinear  systems  with  an  appropriate  modifica¬ 
tion  of  the  theory.  In  particular,  since  the  rings  G  and  H 
are  asymmetric  we  believe  that  asymmetric  concepts  of 
left  and  right  coprimeness  will  be  required  to  achieve  this 
end. 

VII.  Conclusions 

Although  several  of  our  examples  are  characterized  by  a 
deep  analytic  structure  the  key  to  our  fractional  repre¬ 
sentation  approach  to  feedback  system  design  is  the  alge¬ 
braic  nature  of  the  main  results.  Indeed,  the  entirety  of 
our  modeling,  analysis,  and  synthesis  theory  was  derived 
with  no  more  sophisticated  mathematics  than  addition, 
multiplication,  subtraction,  and  inversion.  As  such,  it  ap¬ 


plies  to  essentially  any  class  of  linear  systems  and  by 
proper  choice  of  the  nngs  G  and  H  the  results  are  applica¬ 
ble  to  a  variety  of  systems  problems. 

Although  we  believe  that  the  present  work  represents 
the  first  attempt  at  the  formulation  of  an  axiomatic  frac¬ 
tional  representation  theory  for  systems  which  may  be 
matched  to  the  feedback  system  analysis  and  synthesis 
problems  of  interest  the  work  owes  much  to  a  number  of 
recent  results  on  the  input-output  theory  of  linear  sys¬ 
tems.  The  use  of  a  fractional  representation  theory  for 
multivariate  systems,  though  implicit  in  a  number  of 
classical  results,  was  popularized  by  Rosenbrock’s  poly¬ 
nomial  matrix  fractions  [19].  Interestingly,  however, 
Rosenbrock’s  goal  was  apparently  to  permit  the  powerful 
analytic  and  arithmetic  theory  available  for  polynomial 
matrices  to  be  applied  to  rational  matrices  whereas  the 
present  fractional  representation  theory  is  motivated  by 
the  desire  to  formulate  a  representation  theory  for  systems 
which  is  closed  under  inversion.  Over  the  years  numerous 
generalizations  of  the  polynomial  matrix  fraction  concept 
have  been  formulated  for  distributed  systems  [4],  [5],  [13], 
[21],  and  multidimensional  systems  [9],  [24]  while  partial 
extensions  to  the  time-varying  and  nonlinear  cases  have 
appeared  in  a  number  of  unpublished  reports  [1 1],  [22]. 

For  any  type  of  fractional  representation  theory  to  be 
meaningful  it  must  be  identified  with  an  appropriate 
coprimeness  concept.  Indeed,  the  key  to  the  present  for¬ 
mulation  is  the  use  of  the  algebraic  coprimeness  concept 
of  (2.4)  in  lieu  of  the  more  classical  common  factor 
criterion.  Such  a  criterion  has  previously  been  applied  by 
one  of  the  authors  in  a  study  of  fractional  representations 
for  distributed  system  [4]  and  was  also  shown  to  be  the 
strongest  of  several  possible  coprimeness  criteria  for  mul¬ 
tidimensional  systems  by  Youla  and  Gnavi  [26].  Of 
course,  it  is  well  known  as  one  of  the  several  equivalent 
criteria  for  coprimeness  in  the  polynomial  matrix  fraction 
theory  [16],  [19]. 

The  feedback  system  analysis  theorems  of  Section  III 
are  motivated  by  the  now  classical  theorems  for  determin¬ 
ing  the  stability  of  a  multivariate  feedback  system  in  terms 
of  its  polynomial  matrix  fraction  representation  [10]. 
Moreover,  the  system  synthesis  theorem  is  an  outgrowth 
of  the  feedback  system  stabilization  theorem  of  Youla  et 
al.  [24],  [25].  Indeed,  the  present  work  began  with  an 
attempt  to  give  a  simple  proof  of  this  most  powerful 
analytic  theorem  and  developed  through  several  stages  of 
generalization  and  simplification  into  its  present  form. 
Finally,  the  optimization  theory  used  in  Example  4  repre¬ 
sents  the  generalization  [9]  to  an  operator  theoretic  setting 
of  a  result  originally  developed  by  Youla  et  al.  in  the 
frequency  domain  for  use  in  conjunction  with  their  stabili¬ 
zation  theorem  [24],  [25]. 
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The  main  problem  of  adaptive  control  theory  is  to 
design  a  system  S  which  is  capable  of  automatically 
adjusting  the  generated  control  input  to  the  plant  P. 
Such  adjustments  may  be  necessary  for  a  variety  of 
reasons,  such  as  insufficient  knowledge  about  the 
plant,  plant  perturbations,  etc.  A  multitude  of  adap¬ 
tive  control  techniques  have  been  proposed  through  the 
years.  A  characteristic  shared  by  all  of  them  is  the 
presence  of  some  means  of  identifying  the  unknown  or 
perturbed  plant.  Of  course,  the  design  of  such  a 
mechanism,  termed  here  the  identifier,  is  an  important 
question  in  its  own  right.  The  design,  however,  of  an 
adaptive  controller  is  heavily  influenced  by  the  par¬ 
ticular  technique  used  to  generate  the  control  and  it 
therefore  inherits  the  technique's  features. 

A  recent  advance  in  control  theory  is  an  approach 
to  feedback  control  based  upon  the  representation  of 
the  plant  as  the  ratio  of  two  operators,  both  of  which 
belong  to  an  operator  ring  H.  (Ref).  A  brief  overview 
of  the  approach  is  as  follows.  Consider  the  following 
ring  structure  R 

R  *  (G,H,I,J|  (1.1) 

where  G  is  a  not  necessarily  comutative  ring  with 
identity  representing  the  general  class  of  systems  of 
interest.  The  subring  H  also  contains  the  identity 
and  represents  the  class  of  systems  which  in  some  sense 
are  stable.  I  is  the  set  of  elements  in  H  which  admit 
an  inverse  in  G  and  J  the  set  of  elements  in  H  which 
admit  an  inverse  in  H.  As  shown  in  (Ref), 

GoHcIdJ  (1.2) 

A  plant  P  is  said  to  have  a  doubly  coprime 
fractional  representation  if  for 
(Nr,N],Ur,U1,Vr,V1)c  H  and  (O^O^c  7 

P-N.D/^D,-1^  (1.3) 

-rNr+Vr0r»l  (1.4) 

NlV°lVl*l  (1.5) 

The  aim  now  is  to  design  a  system  5  so  that  the 
system's  input-output  map  h  is  placed  in  H.  Consider 
the  system  shown  in  Fig.  1.1  and  assume  that  P  has  a 
doubly  coprime  fractional  representation. 


•^9 


Fig.  1.1.  A  feedback  control 
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For  any  arbitrary  w,  let  the  compensator  C  be 
defined  as 

C-(wN1+Vr)‘,(-w01H(r).  (1.6) 

It  was  shown  that  if  wcH,  then  the  input-output  map  h 
also  belongs  to  H  and 

h*Nr(-wDj+Ur).  (1.7) 

An  important  element  of  the  approach  is  that  it 
provides  a  complete  characterization  of  the  set  of 
compensators  which  place  h  in  the  ring  H.  It  is  there¬ 
fore  desirable  to  investigate  the  conditions  under 
which  fractionally  represented  feedback  systems  can  be 
adaptively  controlled. 

Suppose  then  that  either  in  the  limit  as  t— ,  or 
for  all  times  t  i  t.,  an  input-output  map  H  in  H  is 
desired;  in  other  words,  suppose  that,  with  the  appro¬ 
priate  time  interpretation,  it  is  required  that 

h*H.  (1 .8) 

Clearly,  there  exists  a  choice  of  three  independent 
variables,  namely  w,  U  and  V  ,  to  satisfy  two  linear 
equations.  The  decision  was  made  to  consider  w  as  a 
parameter  in  H.  Thus  the  problem  can  in  general  be 
stated  as  seeking  the  particular  coprineness  operator 
pair  Ur,Vc  which  for  a  given  w  in  H  simultaneously 
satisfies  tq.s  1.4  and  1.8. 

The  two  main  problems  to  be  addressed  here  are  tne 
acquisition  and  the  plant-follower.  In  the  former, 
the  linear,  time-invariant  plant  P  is  assumed  to  be 
insufficiently  specified  at  the  initial  time  tg.  The 
intention  is  to  provide  a  feedback  system  S  which 
consists  of  an  identifier  I£  and  an  adaptor  AD  as 
shown  in  Fig.  1.2.  The  identifier  provides  the  adaptor 
with  estimates  p(t)  of  the  plant  P  such  that 
lim  p(t)  «  P.  Then,  using  these  estimates,  the  adaptor 


Fig.  1.2.  An  adaptive  control  system. 

provides  the  compensator  with  an  operator  pair 
(ur(t),v  (t)l  such  that  the  required  coprimeness  pair 
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(Ur.Vrl  is  obtained  in  the  limit.  The  first  task  is 
to  delineate  the  class  of  plants  for  which  such  a 
system  is  possible.  This  can  be  done  by  deriving  the 
necessary  and  sufficient  conditions  for  a  solution  to 
exist  under  the  assumption  of  instantaneous  identifi¬ 
cation,  (i.e.,  a  perfect  identifier).  Then  it  would 
remain  to  show  that  in  the  non-ideal  ease  the  solution 
can  be  attained  adaptively.  In  other  words  it  would 
be  required  that  Eq.s  1.4  and  1.8  are  satisfied  in 
the  limit. 

tn  the  plant-follower  problem  the  linear  plant  P 
is  perfectly  known  at  the  initial  time  tjj,  but  it 
undergoes  perturbations  thereafter.  The  intention  is 
to  provide  the  compensator  with  an  operator  pair 
iUr(t),Vr(t))  such  that  the  systems  input-output  map 
remains  invariant  under  the  plant's  perturbations. 

In  other  words  Eq.s  1.4  and  1.8  are  to  be  satisfied  at 
every  point  in  time.  Again  the  class  of  plants  for 
which  a  solution  exists  is  delineated  under  the  per¬ 
fect  identifier  assumption*-  In  the  non-ideal  case  it 
is  desirable  to  examine  the  extent  to  which  the  input- 
output  map  is  perturbed  due  to  the  plant  perturbation. 

As  always,  stability  is  a  question  of  paramount 
importance.  A  consequence  of  the  fractional  represen¬ 
tation  approach  is  the  fact  that  a  system  is  stable 
in  the  sense  of  H  whenever  the  system's  input-output 
map  is  time-invariant  and  the  coprimeness  operators 
belong  to  H.  This  is  exploited  in  the  ideal  case  of 
both  problems.  But,  whereas,  in  the  acquisition  prob¬ 
lem  the  derived  stability  conditions  are  time-inde¬ 
pendent  and  hence  easy  to  check  a  priori,  in  the 
plant-follower  they  are  time-dependent  and  thus  the 
task  of  verifying  whether  they  hold  or  not  is  consid- 
erabley  harder.  However,  the  problem  is  by-passed  by 
showing  that  in  this  ca^e  the  question  of  the  coprime¬ 
ness  operators  belonging  to  H  is  equivalent  to  the 
classical  question  of  stability  in  the  sense  of  if  of  a 
system  with  time-invariant  feedforward  path  and  memory¬ 
less,  time-varying  feedback  path.  In  the  adaptive 
case  of  the  plant-follower  problem  stability  is  re¬ 
solved  by  a  similar  criterion  applied  to  the  entire 
adaptive  acquisition  problem,  the  fact  that  the  input- 
output  map  converges  to  a  time-invariant  element  of  H 
suggests  that  the  system  is  stable  as  long  as  the  map 
remains  bounded.  It  is  shown  that  for  uniform  asymp¬ 
totic  stability  this  is  in  fact  the  case  as  long  as  a 
sufficiently  "good"  identifier  is  used.  (The  quality 
of  the  identifier  is  also  shown  to  be  related  to  the 
robustness  of  the  adaptive  plant-follower  system). 

The  requirement  to  control  the  entire  input- 
output  map  restricts  the  application  to  a  class  of 
plants  which,  for  all  practical  purposes.  Is  only 
slightly  larger  than  the  miniphase  case.  But  if  a 
less  restrictive  requirement  is  imposed  the  class  be¬ 
comes  considerably  larger.  The  point  is  demonstrated 
by  the  pole  positioning  problem  for  plants  represented 
as  rational  functions  (not  necessarily  proper).  It 
is  shown  that  the  problem  is  equivalent  to  solving  a 
linear,  algebraic  equation.  Furthermore,  a  solution 
to  the  equation  is  shown  to  exist  provided  that  the 
number  of  poles  to  be  positioned  Is  sufficiently  large. 
In  terms  of  adaptive  control,  the  equation  must  be 
solved  repeatedly  in  time  by  any  of  the  available 
methods,  (e.g.  a  continuation  algorithm). 
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Sumary 

The  problem  of  designing  a  feedback  system  with 
prescribed  properties  is  attacked  via  a  fractional  rep¬ 
resentation  approach  to  feedback  system  analysis,  and 
synthesis.  To  this  end  we  let  H  denote  a  ring  of  oper¬ 
ators  with  the  prescribed  properties  and  model  a  given 
plant  as  the  ratio  of  two  operators  in  H.  This,  in 
turn,  leads  to  a  simplified  test  to  determine  whether 
or  not  a  feedback  system  in  which  that  plant  is  embedd¬ 
ed  has  the  prescribed  properties  and  a  complete  charac¬ 
terization  of  those  compensators  which  will  "place"  the 
feedback  system  in  H.  The  theory  is  formulated  axio- 
matically  to  permit  its  application  in  a  wide  variety 
of  system  design  problems  and  is  extremely  elementary 
in  nature  requiring  no  more  than  addition,  multiplica¬ 
tion,  subtraction,  and  inversion  for  its  derivation 
even  in  the  most  general  settings. 

I.  Introduction 

Intuitively,  the  linear  feedback  system  design 
process  may  be  broken  down  into  three  steps;  modeling, 
analysis,  and  synthesis;  each  of  which  may  be  carried 
out  via  a  multiplicity  of  time  and  frequency  domain 
techniques.  In  engineering  practice,  however,  the 
three  steps  are  loosely  matched  to  one  another.  The 
Purpose  of  the  present  paper  is  to  use  fractional  repre¬ 
sentation  models  to  the  analysis  and  synthesis  of  feed¬ 
back  systems.  Here,  if  one  desires  to  design  a  system 
with  prescribed  properties  the  given  plant  is  initially 
modeled  as  a  quotient  of  two  operators,  each  of  which 
has  the  desired  properties.  Once  such  a  model  has  been 
specified  a  similar  model  may  be  formulated  for  the 
feedback  system  constructed  from  that  plant  which,  in 
turn,  may  be  used  to  determine  whether  or  not  the  feed¬ 
back  system  has  the  desired  properties.  Moreover,  the 
set  of  compensators  which  will  cause  the  feedback  systen 
to  have  the  prescribed  properties  may  be  completely 
characterized  in  terms  of  such  a  model.  As  such,  by 
choosing  a  model  for  the  plant  which  is  matched  to  the 
design  criteria  the  analysis  and  synthesis  processes 
for  a  feedback  system  may  be  greatly  simplified. 
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•  II.  Axiomatic  Theory 

Let  G  be  a  (not-necessarily-commutative)  ring  with 
identity  and  let  H  be  a  subring  of  G  which  includes  the 
identity.  The  feedback  system  and  its  subsystems  will 
be  represented  by  operators  which  are  elements  of  G. 

The  compensator  will  be  chosen  so  that  the  overall 
system  will  be  represented  by  an  operator  in  the  Sub¬ 
ring  H. 
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We  define  two  multiplicative  subsets  '  of  H: 

I  *  {h  H  |  h_,cG) 

i.e.,  I  is  the  set  of  elements  of  H  which  have  an  in¬ 
verse  in  G; 

J  •  (hcH  |  h_1 

i.e.,  J  is  the  aubgnoup  of  H  consisting  of  all  inverti¬ 
ble  elements  of  H. 

Note  that 

JcIchc  G 

Given  the  above  structure  we  say  that  a  system 
g  c  G  has  a  >u.ght  ^ncJUjonoJ.  a.epiea trUotion  in 
(G,H,I,J)  if  ti.ere  exist  n  c  H  and  d  c  I  such  that 

i  r  • 

g  »  nrdr  .  Furthermore,  we  say  that  the  pair  (nr,dr) 

cHxH  is  nghX  cop'Ume.  if  there  exist  ur  and  vr  in  H 
such  that 


The  fractional  representation  nrdr_1  in  (G,H,I,J)  is 
said  to  be  night  c opnimt  if  the  pair  (nr,dr)  is  right 
coprime. 

The  relationship  between  our  concept  of  coprime- 
ness  and  the  usual  common  factor  criterion  for  coprime- 

ness^8  is  given  by  the  following  properties. 

Property  1:  Let  the  pair  (nr,dr)  c  HxH  be  right  co- 
prime.  Let  np  and  dp  have  a  common  right  factor  r  c  H, 
i.e..  np  ■  xrr,  dp  ■  ypr  for  some  xp  c  H  and  yp  c  H. 
Then  r  has  a  leit  invent  in  H. 

Property  2:  let  g  •  n.dl*  be  a  right-coprime  fractional 
•  r  r  1 
representation  of  g  in  (G.H.t.J).  let  g  »  1  be  a 
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second  (not  necessarily  coprime)  rignt  fractional  rep¬ 
resentation  of  g  in  (G.H.l.J).  Then  there  exists  an 
r  in  H  such  that 


«r  ■  nrr  and  yp  •  dpr. 

Although  6  Is,  In  general  a  nonconmutatlve  ring, 
the  entire  theory  developed  above  for  right  fractional 
representations  can  be  replicated  for  left  fractional 
representations.  In  particular,  we  say  that  g  c  G  has 
a  lt&£  inacXional  MpneAcntation  In  (G.H.l.J)  if  there 

exist  n^  c  H  and  d^  c  I  such  that  g  *^n/*  Furthermore 
we  say  that  the  pair  (n^.  d^)  c  HxH  is  Itit  copnimt  If 
there  exist  and  v^  In  H  such  that 


The  left  fractional  representation  b^n^is  said  to  be 
lt.it  co pnimt  if  the  pair  (n^,d^)  is  left  coprime.  With 

these  definitions  the  existence  of  a  common  ttit  iacton 
for  a  left  fractional  representations  of  g  is  charac¬ 
terized  by  the  following  properties. 


*)  If  dr  c  J.  the  g  t  H; 

b)  If  g  *  npd‘*  Is  a  tight  ccp-.irc  I’.actirnnl  rcpsc- 
tcnttUion  of  g  In  (G.H.l.J),  then  g  t  H  implies  that 
dp  c  J. 

Property  3‘ :  let  g  *  <^n£  w’th  c  H  and  d^  c  t: 
a)  If  d^  e  J,  then  g  c  H; 

b>  If  g  *  d^n^  is  a  hit  coptine  £/uicUionat  nepneaezi- 

totion  of  g  In  (G.H.l.J),  then  g  c  H  implies  that 

i  J. 

Property  4:  Let  g  *  nr^"*n£  where  np,  n^  c  H,  and  del. 

a)  If  d  c  J,  then  g  t  H. 

b)  Let,  in  addition,  n  d"'  be  a  right  coprime  frac- 

'  m  1 

tional  representation  in  (G.H.l.J)  and  d  ln^  be  a  left 

coprime  fractional  representation  ir.  (G.H.l.J);  then 
g  e  H  implies  that  d  c  J. 


Property  1':  Let  the  pair  (n^.d^)  be  left  coprime. 

Let  n^  and  d^  have  a  common  left  factor  t  in  H,  i.e., 
nt  *  xr  df  "  tyl  for  some  %i  C  H  and  y^  c  H.  Then 
l  has  a  tight  inuetae  e  H. 

Property  2‘:  Let  g  »  d^n^  be  a  left  coprime  fraction¬ 
al  representation  of  g  in  (G.H.l.J).  Let  g  «  y*^  be 

a  second  (not  necessarily  coprime)  left  fractional  rep¬ 
resentation  of  g  in  (G.H.l.J).  Then  there  exists  an 
l  in  H  such  that 

’  tnl  and 

The  above  properties  of  a  coprime  fractional  rep¬ 
resentation  have  all  been  derived  under  the  assumption 
that  such  a  representation  exists.  Of  course,  if  G  de¬ 
notes  the  rational  matrices  and  H  the  polynomial  ma¬ 
trices  the  existence  of  a  coprime  representation  is  im¬ 
plied  by  classical  analysis. ^®’^®  Indeed,  the  classi¬ 
cal  analysis  readily  extends  to  the  case  where  H  is 
taken  to  be  the  cxponcntijiUy  itablt  (exp.  stable) 
rat'onal  matrices  or  the  ring  of  proper  rational  ma¬ 
trices  with  poles  in  a  prescribed  region.^®  On  the 
other  hand  for  multidimensional,®®  distributed,*’®  and 

time-varying  systems^’!®  there  is  no  assurance  that  an 
arbitrary  g  c  G  will  admit  a  fractional  representation 
nor  even  that  the  set  of  g  c  G  which  admit  such  a  rep¬ 
resentation  will  be  a  linear  space.  Moreover,  all  g's 
which  admit  a  fractional  representation  may  not  admit 

a  coprime  fractional  representation.®®  In  general,  the 
set  of  g  t  G  which  admit  a  fractional  representation  in 
(G.H.l.J)  will  form  a  subring  of  G  if  and  only  If  the 

Ore  condition  is  satisfied  while  criteria  for  coprime- 
ness  have  been  formulated  in  various  special  cases 

though  no  general  theory  exists. ^'*'®® 

Property  3:  Let  g  «  lyd^1  wi  th  np  c  H  and  dp  c  I : 

(G.H.l.J)  satisfies  the  Ore  condition  for  right  frac¬ 
tional  representations  if,  whenever  g  t  G  admits  a  left 
fractional  representation.  It  also  admits  a  right 

fractional  representation  and  vice-versa®. 


111.  Analysis 

To  start  consider  the  feedback  system  J  of 
figure  1.  ** 


1  y 

9 

P  *  npdp 

Figure  1:  Unity  gain  negative  feedback  system. 

Suppose  that  the  plant  is  described  by  a  right  coprime 
fractional  representation  p  *  n^'1  xn  (G.H.l.J).  The 
closed-loop  dynamics  of  are  described  by  the  maps 

heu  :  u  e  *  heu  *  1  MV'Y*'1 

hyu  :  u  y  ;  hyu  *  *  nr(dr  +  V'1 

Note  that: 

heu  +  hyu  *  1 

We  say  that  J  is  u <eZt  dtiintd  in  G,  (H,  resp.),  if 
heu  c  G’  *H-  re5P-)- 

Note  tnat  the  pairs  (np,  dp  +  np)  and  (dp,  dp  +  np) 

are  right  ccprime;  indeed,  the  right  coprimeness  of 
(np,  dp)  implies 

(up  -  vp)np  +  vp(dp  ♦  np)  »  1 

while 

(vp  -  up)dp  +  up(dp  +  np)  »  1 

Theorem  1 :  Consider  the  feedback  system  J  of 
figure  2.  ,  p 

a)  Let  p  *  npd*  be  a  fractional  representation 

in  (G.H.l.J)  of  the  element  pcG;  then  J 
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■U  ut£L  dtiintd  ir.  0  If  and  only  If  d  ♦  n  *  1. 

1  *  • 

b)  Let  p  *  nrd*1  be  a  a^g/vt  copvcme  fractional 

representation  in  (G,H,I,J)  of  the  elenent  p  c  6; 
then  Ip  “*22  defined  in  H  If  and  only  if 

df  ♦  nr  c  J. 

We  now  consider  the  feedback  system  l  of  Figure  2 
preceded  by  a  compensator  c;  p  and  c  belong  to  G  and 
are  specified  by  their  coprime  fractional  representa¬ 
tion  in  (G,H,I,J)  n^"1  and  y^1*^.  r**p. 


c  *y i1*. 

♦ 

t  *2. 

p  *  n^d"1 

Figure  Z.  Feedback  system  with  plant  and  compensator. 

To  describe  the  feedback  system  we  consider  the  map 
h  :  (u.  ,u,)  t— »  (e, ,e,) ,  Simple  calculations  give 

w  1  C  It 


elul  elu2 


e2ul  e2u2 


(1  ♦  pc)"1  -p(l  +  cp)" 
c(l  ♦  pc)'1  (1  +  cp)"1 


Now  let.  h  :  (Uj.Uj)  I — >{y1.y2).  Using  the  sunning 
node  equations  it  is  easy  to  see  that 

h  -  K(h  -  1)  and  h  *  1  -  Kh  . 
yu  '  eu  *'  eu  yu 

where  K  is  the  symplectic  matrix 


It  is  well  known  that  in  the  case  of  multivariable 
rational  matrices,  one  has  to  consider  the  four  sub¬ 
matrices  of  hfu  because  examples  show  that  any  one  of 

the  submatrices  may  be  unstable  while  the  remaining 
ones  are  stable.  Let  us  calculate: 

h  „  •  (1  ♦  pc)"1  *  1  -  pc(I  ♦  pc}"1 
*lul 

■  1  -  p  (1  ♦  cp)*  c 

1  -1  -1 

*  l  -  pCy£  (rt< Jr  ♦  Y»r)dr  J  e 

*  i  -  «r(y4dr  ♦  xinr)'lxt 
h*  e(l  ♦  pc)*1  «  (1  ♦  cp)'le 

Vl 

*  dr(ytdr  ♦  Vr)  lx£ 

he2u2  *  (1  *  ep,‘’  *  (1  *  fi\nr*rl)  ' 


■  Cy^1  (>'fdr  +  *tn)  d*1) 

•  dr(y£dr  ♦  Vp)'1^ 


hejU2  •  -p(l  ♦  cp)*1  *  -nr(y£dr  ♦  *i"r)’1y4 

We  say  that  £  is  wzlt  deputed  in  G,  (H,  resp.)  If  and 
only  if  each  entry  of  hgu  belongs  to  G,  (H,  resp.). 

Theorem  2:  Consider  the  feedback  system  J  of 
Figure  3.  Let  n^"1  and  y^x^  be  »  right  and  left 

fractional  representations  of  P  and  c  in  (G.H.I.Jl. 
*)  IT  y^dr  ♦  x^nr  c  I,  then  l  is  well  defined 

in  G. 

•  b)  If  y2dr  +  x^nr  c  J,  then  £  is  well  defined 
in  H. 

c)  If  he  u  c  G  then  y^r  *  x^nr  c  I  hence  if  l 
is  well  defined  in  G  then  y^dr  ♦  x^nr  c  I. 

d)  Assume,  in  addition,  that  np(y.d  J*1  and 
{y^d|.)"1x^  are  right  coprime  and  left  coprime 

factori zational  representation,  resp.;  then 
he  u  c  H  implies  that  y^d,.  ♦  *^nr  *  a°d  hence 

if  J  is  well  defined  in  H  then  y^dr  *  *f_nr  *  J- 

Note,  the  special  assumptions  used  in  d)  to  the  effect 
that  nr(y^dr)*1  H  right  coprime  and  (y^"1!^  is  left 

coprime,  imply,  in  some  sense,  that  p  and  c  have  no 
common  factors.  More  precisely,  since  J  serves  as  the 
group  Of  units  in  our  theory  these  conditions  imply 
that  any  common  factors  of  p  and  c  nxjst  lie  in  J. 

IV.  Design 

Consistent  with  our  approach  of  matching  the  plant 
model  to  the  goal  of  the  given  feedback  system  design 
problem  the  present  section  is  devoted  to  the  problem 
of  characterizing  the  set  of  compensators  which  will 
"place"  a  feedback  system  in  a  prescribed  ring  H  given 
that  both  the  plant  and  compensator  are  modeled  by 
fractional  representations  in  (G.H.I.Jl. 

Theorem  3:  For  the  feedback  system  \  of  Figure  2, 
let  the  plant  p  have  a  right  coprime  and  a^left 

coprime  fractional  representation  p  *  nrdr  * 
d^n^  in  (G.H.I.Jl.  Then  for  any  w  c  H  such  that 
wn2  *  vp  c  1»  the  compensator 

c  •  (wn£  ♦  vr)'1(-»rdi+  »r)x  6 

results  in  a  feedback  system  \  well-defined  in  H. 

2x  Z 

For  such  a  compensator,  h  t  H  and 

1  -  "r(-wdt  ♦  ur)  -  nr(wn£  ♦  vf) 

heu  , 

V-wd*  ♦  «P>  dr<wn*  ♦  vr> 

Conversely,  if  £  is  well  defined  in  H  and  if  the 


camncnsator  c  •  Is  such  that  (r>r,y£dr)  and 

4re  r’9ht  c°nr(r*  and  left  coprine 

resp.,  then  c  Is  given  by  the  above  equation. 

Finally,  we  note  that  although  theorem  3  yields  a 
complete  design  theory  for  a  feedback  system  given 
that  Its  olant  has  both  right  and  left  copr1n«  frac¬ 
tional  representations  in  {G,H,I,J}  one  has  no  a- 
prlorl  assurance  that  such  fractional  representations 
exists  (except  In  some  known  cases).  It  has  been  con¬ 
jectured,  however,  that  this  requirement  Is  a  necessary 
condition  for  the  existence  of  a  compensator  which  will 

"place”  the  feedback  system  In  H.9  Of  course,  we  have 
already  shown  that  the  requirement  of  coprimeness  is  a 
sufficient  condition  for  the  existence  of  such  a  com¬ 
pensator. 

V.  Conclusions 

The  key  to  our  fractional  representation  approach 
to  feedback  system  design  is  the  algebraic  nature  of 
the  main  results.  Indeed,  the  entirety  of  our  model¬ 
ing,  analysis,  and  synthesis'  theory  was  derived  with 
no  more  sophisticated  mathematics  than  addition,  multi¬ 
plication.  substraction  and  inversion.  As  such.  It 
applies  to  essentially  any  class  of  linear  systems  and 
by  proper  choice  of  the  rings  G  and  H  the  results  are 
applicable  to  a  variety  of  systems  problems. 

Although  we  believe  that  the  present  work  repre¬ 
sents  the  first  attempt  at  the  formulation  of  an  axio¬ 
matic  fractional  representation  theory  for  systems 
which  may  be  matched  to  the  feedback  system  analysis 
and  synthesis  problems  of  interest,  the  work  owes  much 
to  a  number  of  recent  results  on  the  input-output 
theory  of  linear  systems.  The  use  of  a  fractional  rep¬ 
resentation  theory  for  multivariate  systems,  though  im¬ 
plicit  in  a  number  of  classical  results,  was  populariz¬ 
ed  by  Rosenbrock's  polynomial  matrix  fractions.19 
Interestingly,  however,  Rosenbroux's  goal  was  apparent¬ 
ly  to  permit  the  powerful  analytic  and  arithmetic 
theory  available  for  polynomial  matrices  to  be  applied 
to  rational  matrices,  whereas,  the  present  fractional 
representation  theory  is  motivated  by  the  desire  to 
formulate  a  representation  theory  for  systems  which  is 
closed  under  inversion.  Over  the  years  numerous 
generalizations  of  the  polynomial  matrix  fraction  con¬ 
cept  have  been  formulated  for  distributed  systems 

4,5,13,2]  my} tidimens i onal  systems9, ^  while  par¬ 
tial  extensions  to  the  time-varying  and  nonlinear  cases 

have  appeared  in  a  number  of  unpublished  reports. 1  1 

For  any  type  of  fractional  representation  theory 
to  be  meaningful  it  must  be  identified  with  an  appro-’ 
priate  coprimeness  concept.  Indeed,  the  key  to  the 
present  formulation  is  the  use  of  the  algebraic  co¬ 
primeness  concept  in  lieu  of  the  more  classical  common 
factor  criterion.  Such  a  criterion  has  previously  been 
applied  by  one  of  the  authors  in  a  study  of  fractional 

representations  for  distributed  systems*  and  was  also 
shown  to  be  the  strongest  of  several  possible  coprime¬ 
ness  criteria  for  multidimensional  systems  by  Youla  and 

**nay*-  Of  course,  it  is  well  known  as  one  of  the 
several  equivalent  criteria  for  coprimeness  in  the 

polynomial  matrix  fraction  theory.1®’19 

The  feedback  system  analysis  theorems  of  section 
III  are  motivated  by  the  now  classical  theorems  for  de¬ 
termining  the  stability  of  a  nxil tivariate  feedback 
system  in  terms  of  Its  polynomial  matrix  fraction 

representation. 111  Moreover,  the  system  synthesis 
theorem  Is  an  outgrowth  of  the  feedback  system  stabi¬ 


lization  tK?cre-  of  Youla,  Bc-giorno,  and  Jabr.^ 

Indeed,  the  present  work  began  with  an  attempt  to  give 
a  simple  proof  of  this  most  powerful  analytic  theorem 
and  developed  through  several  stages  of  generalization 
and  simplification  into  Its  present  form. 
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FEEDBACK  SYSTEM  DESIGN: 

THE  TRACKING  AND  DISTURBANCE  REJECTION  PROBLEMS 


R.  Saeks  and  J.  Murray 


I 


Abstract 


The  problem  of  designing  a  compensator  for  a  specified  plant 
which  simultaneously  stablizes  the  resultant  feedback  system  and 
causes  it  to  track  a  prescribed  family  of  inputs  and/or  reject 
prescribed  disturbances  is  considered.  A  set  of  linear  design 
equations,  in  the  space  of  stable  systems,  is  formulated  in  a 
general  linear  systems  setting  and  an  explicit  parameterization  of 
the  resultant  solution  space  is  obtained  for  a  class  of  "generalized 
multivariate"  systems.  The  theory  is  illustrated  with  several 
single  and  multivariate  examples. 
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Global  Controllability  of  Nonlinear  Systems  in  Two  Dimensions 

L.  R.  Hunt* 
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Abstract.  Let  M  be  a  connected  real-analytic  2-dimensional  manifold. 
Consider  the  system 

*(<)  “  /WO)  +  "(OsWO)WO)  *  x0  S  M, 

where  /  and  g  are  real-analytic  vector  fields  on  M  which  are  linearly 
independent  at  some  point  of  M,  and  u  is  a  real-valued  control.  Sufficient 
conditions  on  the  vector  fields  /  and  g  are  given  so  that  the  system  is 
controllable  from  xQ.  Suppose  that  every  nontrivial  integral  curve  of  g  has  a 
point  p  where  /  and  g  are  linearly  dependent,  g(p)  is  nonzero,  and  that  the 
Lie  bracket  [/,g]  and  g  are  linearly  independent  at  p.  Then  the  system  is 
controllable  (with  the  possible  exception  of  a  closed,  nowhere  dense  set 
which  is  not  reachable)  from  any  point  x0  such  that  the  vector  space 
dimension  of  the  Lie  algebra  LA  generated  by  /,g  and  successive  Lie 
brackets  is  2  at  x0. 


I.  Introduction 

Suppose  we  have  the  system 

-*(0  ”/W0)  +  2  “,(0&W 0)>  x(°)  ”  -*o  e  M,  (1.1) 

;-i 

where  M  is  a  connected  real-analytic  n-dimensional  manifold,  /,g,,...,gm  are 
real-analytic  complete  vector  fields  on  M,  and  u um  are  real-valued  controls. 
A  theory  has  recently  been  developed  in  [7],  [8],  and  [9]  which  characterizes  the 

largest  subset  of  M  which  is  reachable  from  x0  under  assumptions  on  f,g . . 

and  certain  Lie  algebras  generated  by  these  vector  fields. 


‘Raearch  supported  in  part  by  the  National  Science  Foundation  under  NSF  Grant  MCS76- 
0S267-A01  and  by  the  Joint  Services  Electronics  Program  under  ONR  Contract  76-C-1136. 


43 


L.  R.  Hunt 


We  are  interested  in  the  implementation  of  these  results  for  the  system 

-*(')  “  /(*{'))  +  u(t)g{x(l)),  x(0)  -  x0  <=  M,  (1.2) 

where  M  is  a  connected  real-analytic  2-dimensional  manifold,  /  and  g  are 
real-analytic  vector  fields  on  M,  and  u  is  a  control.  The  theory  as  given  in  [9] 
suggests  that  in  examining  the  controllability  of  the  system  from  x0,  the 
important  item  to  check  is  the  direction  of  the  vector  field  /  along  the  integral 
curves  of  g.  We  make  the  assumptions  that  /  and  g  are  linearly  independent  at 
some  point  of  M  (a  very  natural  assumption)  and  that  the  Lie  algebra  LA 
generated  by  /,g  and  successive  Lie  brackets  has  vector  space  dimension  2  at  x0 
(in  order  that  an  open  set  of  M  be  reachable  from  Xq). 

To  find  sufficient  conditions  that  the  system  (1.2)  be  controllable  from  x0, 
we  show  that  the  points  of  interest  are  those  where  /  and  g  are  linearly 
dependent  and  g  is  nonzero.  For  each  such  point  there  is  a  control  which  makes 
this  point  an  equilibrium  point  of  the  system.  If  every  nontrivial  integral  curve 
of  g  has  such  a  point,  and  the  Lie  bracket  [ f,g]  and  g  are  linearly  mdependent 
for  at  least  one  such  point  on  each  integral  curve,  then  the  system  (1.2)  is 
controllable  from  any  point  x0  with  the  vector  space  dimension  of  LA  at  x0  being 
2.  There  may  be  a  closed  nowhere  dense  subset  of  M  which  is  not  reachable 
from  Xq,  e.g.  a  common  equilibrium  (zero)  point  of  /  and  g  is  certainly  not 
reachable.  Thus  controllable  means  controllable  modulo  such  points.  Also 
equilibrium  points  of  g  must  be  treated  separately  using  the  results  from  [9], 
Many  examples  are  given  which  explain  the  important  geometry  near  those 
points  where  /  and  g  are  linearly  dependent.  These  examples  also  illustrate  the 
ease  with  which  the  theory  can  be  implemented. 

It  is  interesting  to  see  the  implications  of  our  theory  in  the  linear  case. 
Suppose  we  consider  the  linear  system 

x(r)  -  Ax(t )  +  u(t)B,  x(0)  -  x0  e  R2,  (1.3) 

where  A  and  B  are  2x2  constant  matrices.  The  Lie  bracket  of  the  vector  fields 
Ax  and  B  is  the  constant  vector  field  AB.  Thus  if  AB  and  B  are  linearly 
independent  at  some  point  of  R2  (i.e,  the  controllability  matrix  has  rank  2),  then 
the  linear  system  (1.3)  is  controllable  from  any  x0eR2. 

An  interesting  expository  article  giving  results  on  controllability  for  nonlin¬ 
ear  systems  is  due  to  Brocket!  [1].  Related  theories  can  be  found  in  [10],  [11], 
[12],  and  [13].  We  must  stress  the  difference  between  our  results  and  the  nice 
theory  for  local  controllability  along  a  reference  trajectory  given  by  Hermes  in 
[4],  [5],  and  [6].  If  A(t,x „)  denotes  the  set  of  all  points  attainable  at  time  t  by 
solutions  of  (1.2)  corresponding  to  admissible  controls  and  initiating  from  x0  at 
time  0,  Hermes  [4]  examines  if  the  point  <p(t)  (the  solution  to  (1.2)  at  time  t 
starting  at  x0  with  control  #50)  is  an  interior  point  of  A(t,xJ  or  not. 

Section  2  of  this  article  contains  definitions,  examples,  and  the  statement 
and  proof  of  our  main  result.  Necessary  conditions  and  other  problems  concern¬ 
ing  global  controllability  are  examined  in  section  3. 
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II.  Definitions,  Examples,  and  a  Global  Result 


For  the  first  part  of  this  section  we  state  definitions  and  a  result  for  an 
n -dimensional  hypersurface  system,  but  later  we  restrict  our  attention  to  the 
2-dimensional  system. 

If  Af  is  a  connected-real-analytic  n-dimensional  manifold,  consider  the 
hypersurface  system 

*0)  -  +  2  «.(')&(*(')).  x(0)  -  x0  e  Af,  (2.1) 

i-i 


where  f,g\,...,gH-\  are  real-analytic  vector  fields,  and  u,(. are  controls. 

By  T(M)  we  denote  the  tangent  bundle  of  Af  with  fiber  (tangent  space) 
TX(M)  for  xSAf.  If  AT  is  a  vector  field  on  Af,  then  a  is  an  integral  curve  of  AT  if  a 

dq( 

maps  the  closed  mterval  /  c  R  into  Af  so  that  — •  -  X(a(t))  for  all  r  £  I.  If  D 

dt 

is  a  subset  of  T(Af),  then  an  integral  curve  of  D  is  a  mapping  a  from  a  real 
interval  [/,/']  into  Af  such  that  there  exist  p-  r0 < r , ...tk  —  t'  and  vector  fields 
Xt,...,Xk  in  D  with  the  restriction  of  a  to  being  an  integral  curve  of  Xt, 

for  each  t  —  1,2,..., A.  A  point  xS  Af  is  D-  reachable  from  x0  if  there  is  an  integral 
curve  a  of  D  and  some  T  >  0  in  the  interval  for  a  such  that  a(0)  “  x0  and 
a(T)~x.  A  subset  A  of  A{  is  D-reachable  from  x0  if  every  point  xGA  is 
reachable  from  x0. 

Since  the  D  under  consideration  is  the  subset  of  7*(Af  )  determined  by  the 
vector  fields  in  (2.1),  we  drop  the  D  from  D-reachable.  If  an  open  subset  of  Af  is 
reachable  from  Xq,  then  the  largest  open  subset  U  of  Af  which  is  reachable  from 
Xq  is  called  the  region  of  reachability  from  Xq.  If  £/—  Af,  we  say  that  the  system  is 
controllable  from  and  controllability  from  every  x0e  Af  gives  us  a  controllable 
system. 

Let  O  be  an  open  set_in  Af  and  let  x  €  dO.  The  vector  field  /  points  in  the 
direction  of  O  (or  towards  O)  at  x  if  there  is  an  open  neighborhood  W  of  x  in  Af 
such  that  the  integral  curve  of  /  starting  at  x  and  intersected  with  W  is  contained 
in  O.  In  addition  if  30  is  Q'  near  x  and  /( x)  is  not  tangent  to  30 _at  x,  then  / 
points  in  the  direction  of  O  (or  towards  O)  at  x.  If  /  points  towards  O  (or  O)  for 
all  jcS30,  then  f  points  in  the  direction  of  O  (or  O)  on  30.  Given  two  vector 
fields  A,  and  h2  on  Af,  the  Lie  bracket  of  A,  and  A2  is  defined  by 


3A,  3A, 

where  -r—  and  -r—  denote  Jacobian  matrices.  Of  course  other  Lie  brackets  like 
ox  ox 


[A'JA^Aj]],...  can  be  taken. 

By  La  we  denote  the  Lie  algebra  generated  by /,g|,...,g„_i  and  successive 
Lie  brackets,  and  by  L’A  we  denote  the  Lie  algebra  generated  by  and 

successive  Lie  brackets. 

Our  first  theorem,  which  characterizes  the  region  of  reachability  from  x0  for 
the  system  (2.1)  is  taken  from  [9].  It  is  this  theorem  that  we  are  interested  in 
implementing  for  the  2-dimensional  case. 
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Theorem  2.1.  Assume  the  vector  space  dimension  of  LA  at  x0  is  n  and  that 
are  linearly  independent  at  some  point  of  M.  Let  U  be  the  smallest 
open  subset  of  M  with  x0S  U  satisfying  dU  contains  the  integral  manifolds  of  L'A 
which  intersect  it  ( and  which  are  given  by  Chow’s  Theorem  [2])  and  f  points  in  the 
direction  of  U  on  31/.  Then  U  is  the  region  of  reachability  from  x0  for  the  system 
(2.1). 

In  the  statement  of  this  theorem,  we  should  add  the  assumption  that  if 
U*PM,  every  open  neighborhood  of  any  point  pSdU  contains  points  from  U 
and  the  complement  of  U.  G.  Stefani  and  A.  Baccioti  have  pointed  out  that  the 
correct  conclusion  to  the  theorem  as  stated  above  is  U  c  region  of  reachability 
C  interior  of  U.  The  author  wishes  to  thank  Professors  Stefani  and  Baccioti  for 
their  comments. 

The  set  P  of  points  in  M  where  the  vector  space  dimension  of  LA  is  less  than 
n  is  a  closed  nowhere  dense  subset  of  M  il  the  dimension  at  one  point  x0  is  n 
(see  (9]).  If  there  is  no  proper  open  set  U CM  with  3 U  as  in  the  theorem  and 
with  3 U  disconnecting  M,  then  the  system  (2.1)  is  controllable  from  x0  (as  stated 
in  the  introduction,  there  may  be  a  subset  of  P,  e.g.  common  equilibrium  points 
of  /  and  g,  which  is  not  reachable).  If  such  a  set  U  exists,  then  the  system  is 
certainly  not  controllable. 

Unless  otherwise  noted  for  the  remainder  of  this  paper  we  restrict  our 
attention  to  the  2-dimensional  system 


HO 


H(0 

H(0 


MHO) 

MHO) 


+  u(t) 


gi(H0) 

gi(H0) 


mf(H0)  +  «(')s,(*('))>*(0)“  x0eM, 


where  M  is  our  connected  2-dimensional  manifold.  We  assume  that  the 
equilibrium  points  of  the  system  x(t)—f(x(t))  are  isolated.  The  set  of  points 
where  /  and  g  are  linearly  dependent  are  given  by  the  equation  ffx)g2(x)  — 
M*)g  i(*)“0- 

To  obtain  a  perspective  on  the  global  controllability  of  our  system  (2.2)  we 
consider  a  linear  and  a  nonlinear  example. 


Example  2.1.  On  R2  let 


•^1 

0  1 

JC| 

'  l ' 

1 

1  0 

.  X2 

+  HO 

0 

m  AHO)  +  HOg(HO)  -  aHO  +  HOB. 


Since  the  matrix  [B,AB]  has  rank  2,  this  system  is  controllable  from  any  point 
x0  in  R2.  However,  the  important  fact  geometrically  is  how  the  vector  field  / 
behaves  along  the  integral  curves  of  g  near  the  points  where  /  and  g  are  linearly 
dependent  The  set  of  points  (xvx{)  in  R2  where  /  and  g  are  dependent  are  on 
the  straight  line  x,  —  0.  We  take  an  arbitrary  integral  curve  of  g,  say 
constant  which  divides  R2  into  two  connected  components  {x€R2:x2>c}  and 
{xSR2:x2<c}.  Let  «  be  a  small  positive  number.  At  a  point  (-e,c)  on  x2—c,/ 
points  towards  (rSR2:x2<c),  and  at  a  point  (e,c)  on  x2  —  c, /  points  towards 
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Fig.  t. 


{x  G  R2 :  x2  >c}.  Thus  the  vector  field  /“turns  through”  the  integral  curve  of  g  at 
the  point  on  x2  —  c  where  /  and  g  are  linearly  dependent.  Since  this  occurs  for 
every  integral  curve  of  g,  we  have  by  Theorem  2. 1  that  no  integral  curve  of  g  can 
be  the  boundary  of  the  region  of  reachability  from  any  x0ER2.  Hence  this 
system  is  controllable  from  every  x0  £  R2. 

Since  the  standard  linear  methods  for  proving  controllability  of  a  linear 
system  will  not  generalize  to  the  nonlinear  case,  it  is  the  vector  field  /  “turning 
through"  the  integral  curves  of  g  at  points  where  /  and  g  are  linearly  dependent 
that  becomes  the  essential  item  in  the  nonlinear  theory.  We  show  later  that  this 
“turning”  occurs  at  points  where /and  g  are  linearly  dependent  and  where  [/,g] 
and  g  are  linearly  independent. 


Example  2.2.  Consider 

1 

m  /MO)  +  «(0*M0).  *(0)  •  x0  e  R2. 


x(0“ 


*i(0 

■*2(0 


+  «(0 


This  example  satisfies  the  hypotheses  of  Theorem  2.1  since  /  and  g  are  linearly 
dependent  if  and  only  if  x2  — 0  and  the  dimension  of  LA  at  every  point  XgER2  is 

2.  Every  integral  curve  of  g  intersects  the  line  x2— 0  (note  that  [  *2  ]  is  not 

horizontal  in  the  plane).  Computing 


[/•«] 


[0  IT 

X2 

+ 

0 

-1  If  *al 

2 ■ 

O 

O 

1 

.0 

0  J  [  1 

.  0. 

and  [f,g]  and  g  are  linearly  independent  at  points  where  x2— 0. 
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An  integral  curve  of  g  divides  R1  into  two  connected  components.  Let  <  be  a 
small  positive  number.  From  the  picture  we  see  that  the  vector  field  /  “turns 
through”  the  integral  curve  of  g  at  the  point  where  x2  ->0.  Since  this  happens  for 
all  such  integral  curves,  the  system  is  controllable  on  R2  Again,  this  “turning”  is 
implied  by  the  computation  on  ( f,g]  as  we  show  in  our  main  result.  Theorem 
2.2. 

Now  we  return  to  our  general  2-dimensional  system  (2.2).  Let  pGM  be  a 
point  where  f(p)  and  g(p)  are  nonzero  and  ffp)  and  g(p)  are  linearly  dependent. 
For  a  sufficiently  small  open  neighborhood  V  of  p  in  M,  the  integral  curve  of  g 
through  p  divides  V  into  two  connected  open  components.  We  say  that  f  lies  on 
one  side  of  g  near  p  if  the  integral  curve  off  through  p  (with  the  point p  deleted) 
in  some  small  open  neighborhood,  say  V,  of  p  is  contained  in  one  of  the  two 
connected  components  of  V  determined  by  the  integral  curve  of  g  through  p. 

This  property  of  /  lying  on  one  side  of  g  near  p  is  of  course  invariant  under 
rotations  on  R2  if  we  are  working  in  Rz.  Since  M  is  a  real-analytic  2-dimensional 


integral  curve  of  f 


t 
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manifold  there  is  an  open  neighborhood  of  p  in  M  which  is  real-analytically 
homeomorphic  to  an  open  neighborhood  of  the  origin  in  R2.  Hence  there  is  no 


generality  loss  in  assuming  that  g(p) 


and  that  we  are  working  locally  in 


some  neighborhood  of  the  point  p  =  (0, 0)  in  R2.  Then  to  show  that  /lies  on  one 
side  of  g  near p  we  need  only  show  that  the  integral  curve  of  /  through  p  minus 
the  integral  curve  of  g  through  p  has  a  local  maximum  or  local  minimum  at  p.  If 
this  occurs  then  the  flow  generated  by  /  through  certain  points  near  p  must 
intersect  the  integral  curve  of  g  through  p  in  such  a  way  that  the  vector  field  / 
“turns  through”  the  integral  curve  of  g  through  p. 

We  now  state  and  prove  the  main  result.  In  the  definition  of  integral  curve 
of  g  we  could  include  an  integral  curve  (where  g  is  nonzero)  together  with  an 
equilibrium  point  of  g  and  another  integral  curve  of  g  (with  g  nonzero).  For 
example,  we  could  call  the  positive  x2  axis  together  with  the  origin  and  the 
positive  x,  axis  in  the  system 


*(/) 


*1  (t) 

0  1  ‘ 

+  u(t) 

1  o' 

*1 

x2(t) 

1  0 

0  -1 

.*2. 

on  R2 


an  integral  curve  of  g.  However,  we  assume  that  g  is  nonzero  in  the  statement  of 
our  main  result,  and  in  certain  examples  given  after  the  theorem  we  show  how  to 
handle  equilibrium  points  of  g  and  common  equilibrium  points  of  /  and  g  using 
Theorems  2.1  and  2.2  together. 


Theorem  2J2.  Assume  that  f  and  g  are  linearly  independent  at  some  point  of  M 
and  that  g  never  vanishes  on  M.  Suppose  every  integral  curve  of  g  which 
disconnects  M  has  a  point  p  where  f  and  g  are  linearly  dependent  and  [f,g]  and  g 
are  linearly  independent.  Then  the  system  (2.2)  is  controllable  from  any  point  x0 
such  that  the  vector  space  dimension  of  LA  at  x0  is  2. 


Proof.  Suppose  that  f(p)  is  nonzero,  the  case/(p)> 


in  the  proof,  and  assume  that  g(p)aB 


being  considered  later 


.  As  before,  we  are  working  in  a 


neighborhood  of  the  point  p  “(0,0)  in  R2.  We  must  show  that  [/,g]  and  g  being 
linearly  independent  at  p  (which  is  invariant  under  coordinate  changes)  implies 
that  the  integral  curve  of  /  through  p  minus  the  integral  curve  of  g  through  p 
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(both  considered  as  functions  of  the  x,  variable)  has  a  local  maximum  or  local 
minimum  at  p.  By  the  discussion  preceding  the  statement  of  the  theorem,  this 
integral  curve  of  g  cannot  be  the  boundary  of  the  region  of  reachability  U  from 
x0  in  Theorem  2.1. 

Since 


*2(1) 


/i(*(')) 

,/2(*(0) 


+  «(/). 


i  i(-*(0) 


>g(p) 


1 

0 


>Ap)  * 


0 

0 


and  f(p)  and  g(p)  linearly  dependent,  we  must  have  /|(p)^0,  g\(p)¥zO  and 
fiLp)mgi(P)-0- 

The  first  derivative  of  the  integral  curve  of  /  minus  the  integral  curve  of  g 
with  x2  considered  as  a  function  of  x,  is  given  by 

fi(x(‘))  g2(x(0) 

fi(x(0)  g,(*0)) 

The  second  derivative  is  given  as 


1 


/.(*('))*,(*(')) 


,  ,,  ,^dg2(x(0) 

gi(x('))—2 - Mx0))~ 


By  the  second  derivative  test  we  have  the  desired  local  maximum  or  local 
minimum  provided 


Si(*) 


3/2(*)  ,  ,  x  9?2(*) 


3*i 


-/.(*)- 


3x, 


#  0  alp. 


Computing 


[/•«] 


3gi(*) 

8-x, 

9«i(*) 

3x2 

/i(*) 

9/iW 

3x, 

9/,(*)  ' 

3x2 

«i(*) 

dg2(*) 

3x, 

3x2 

J 

f2(x) 

%(*) 

3x, 

3/a(*) 

3x2 

S2(*) 

Then  (/,g)  and  g  are  linearly  dependent  at  p  if  and  only  if 


dMx)  ,  x  ,  3/2(x)  3g2(*)  , ,  N  3g2(x) 

+ ~sr*>w  -  -57-Aw  -  -5r«*> 


1  3x2  ozv  7  3x,  u*j 


at  p  since  g2(p)m0.  Because  /2(p)“  g2(p)“0,  [/,g]  and  g  are  linearly  indepen¬ 
dent  at  p  if  and  only  if 

3/i(*)  9*2(*)  ,  ,  >  ,  n 
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Up.  Thus  we  must  have  the  desired  local  maximum  or  local  minimum  from  our 
assumption  on  [/,g]  and  g. 

It  remains  to  consider  the  case  where  /(p)-|®  j.  Recall  that  /  and  g  are 
linearly  dependent  at  the  set  of  points  /,(x)g2(x)-/2(x)g,(x)-0.  Again  we 
assume  that  g(/>)-  IM,  implying /2(/>)-g2(/>)-0.  We  apply  the  implicit  func¬ 
tion  theorem  to  the  set  of  points  where  /,(*)g2(x)-/2(x)g,(x)-0,  near  p.  Since 


9/iW  ,  »  9 g2(*)  f „  9/2(x)  ,  x  3g,(x)  . ,  , 


9gj(jc) 


/.(*)-■ 


-g,(x)  atp, 


our  assumption  on  [/,g]  and  g  impUes  g|(/>)#0  at p.  Thus 

the  zero  set  of  /i(x)g2(x)  —  /2(x)g|(x)  defines  a  real-analytic  1-dimensional 
submanifold  S  of  M  near  p. 

Recall  that  we  assumed  the  equilibrium  points  of 


.  *:(')  [/jWO) 


are  isolated.  Hence  we  take  all  points  of  5  except  p  to  be  points  at  which /(x)  is 
not  equal  to  ^  ®  j.  We  choose  an  open  neighborhood  W  of  p  in  M  such  that 

(i)  p  is  only  point  in  W  with  f(p)  -  ®  , 

(ii)  the  only  points  in  W  where  /  and  g  are  linearly  dependent  are  those  in 

sn  w, 

(ii)  given  any  point  qSS  n  W  with  q^p,  the  integral  curve  of  g  through  q 
divides  W  into  two  connected  open  components  and  the  vector  field  f 
points  in  the  direction  of  one  component  on  one  side  of  q  in  the  integral 
curve  and  in  the  direction  of  the  other  component  on  the  other  side  of  <7  in 
the  integral  curve,  and 

(iv)  [f,g]  and  g  are  linearly  independent  on  W. 


Part  (iii)  follows  from  the  first  part  of  this  proof  since  f{q)¥*  ®  and  (ii).  The 

set  W  can  also  be  chosen  so  that  the  integral  curve  of  g  through  p  divides  W  two 
connected  open  components.  Suppose  /  points  in  the  direction  of  the  closure  of 


one  of  these  components  along  the  integral  curve  of  g  in  W.  Since  the  integral 
curves  of  g  vary  smoothly  (as  we  move  from  curve  to  curve),  the  only  way  the 
preceding  statement  can  hold  in  view  of  (iii)  is  to  have  the  integral  curves  of/ 
and  g  coincide  on  one  side  of  p  along  the  integral  curve  of  g  through  p.  But  [f,g] 
must  vanish  along  such  a  set,  a  contradiction  to  (iv). 

Hence  we  have  that  the  vector  field  /  must  “turn  through”  every  integral 
curve  of  g  which  disconnects  M  at  some  point  in  5  on  each  such  curve.  Since  M 
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is  connected,  the  only  set  U  satisfying  Theorem  2. 1  for  our  x0  must  be  equal  to 
M  itself.  Thus  the  system  (2.2)  is  controllable  from  any  such  □ 

As  an  easy  application  of  this  theory  we  could  prove  the  known  controllabil¬ 
ity  theorem  for  a  linear  system  in  R2,  but  remarks  in  this  direction  have  already 
been  made. 

We  now  give  several  examples  of  nonlinear  systems  to  illustrate  bow  to 
apply  Theorem  22. 

Example  2.3.  Consider 


HO 


*i(') 

x2(t) 


u(t) 


1 


*0  e  R2. 


-  AHO)  +  «(')*(*(')).  *(0) 

The  set  of  points  in  R2  where  /  and  g  are  linearly  dependent  is  defined  by 
4— which  gives  two  lines  x2  — 2  and  x2  —  —  2.  Computing 


[/•*]  “  - 


■*2]  +  ro  i  ][  4  _[  -v 
.  1  lo  o  J  L  -*2  J  i  . 


Thus  the  vector  space  dimension  of  LA  at  any  point  jc0  is  2  and  [f,g]  and  g  are 
linearly  independent  on  the  straight  lines  x2=»2  and  x2“  —  2.  Since  every 
integral  curve  of  g  intersects  these  lines,  we  have  a  controllable  system  by 
Theorem  2.2. 


Example  2.4.  Consider 


HO- 


X,(0 

x2(0 


1 


+  «(/) 


1 


fo  i] 

*2 

+ 

0  2x2 

x2 

- 

l-2x2 

o 

o 

1 

0  0 

.  1  . 

0  . 

-  Ax{t))  +  u(t)g{x(t)),  *(0)  -  x0  e  R2. 

The  set  of  points  in  R2  where  /  and  g  are  linearly  dependent  is  defined  by 
the  straight  lines  x2  «0  and  x2  —  1.  Computing 

[/•*]  *  - 

Then  [f,g]  and  g  are  linearly  independent  on  x2m0  and  jc2  *>  1  and  the  vector 
space  dimension  of  LA  is  2  everywhere.  Since  g  has  no  horizontal  tangent 
vectors  in  the  plane,  all  integral  curves  of  g  must  intersect  these  lines.  Hence  this 
system  is  controllable. 

Example  2.5.  Let 

*i(0 


HO 


HO) 


-X, 


0  - 1 

*1 

+  «( 0 

[‘ 

0 

xt 

1  0 

x2 

.0 

-4 

x2 

+  u(0 


-4x, 


-Ax(t))+u(t)g(x(t)l 

where  x(0) — x0  S  R2  -  (0, 0). 
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The  origin  in  R2  is  a  common  equilibrium  point  of  /  and  g.  The  vector  fields 
/  and  g  are  linearly  dependent  on  the  set  of  points  defined  by  4x2  -  x2  «■  0  or 
x,  “  ±2xr  We  have 


Thus  l/,g]  and  g  are  linearly  independent  on  x,  —  2x2  and  x,—  —  2x2  except  at 
the  point  (0,0).  Also  the  vector  space  dimension  of  LA  at  every  point  in 
R2-(0,0)  is  2. 

Let’s  apply  Theorem  2.2  to  the  open  first  quadrant.  It  is  easy  to  show  that 
any  integral  curve  of  g  which  starts  in  the  first  quadrant  intersects  the  line 
x,’m2x2  (we  can  move  forward  and  backward  in  time  along  integral  curves  of  g 
since  it  is  the  vector  field  we  control).  By  Theorem  2.2  we  know  the  first 
quadrant  is  reachable  from  any  point  x0  in  the  first  quadrant.  Similar  arguments 
imply  the  same  result  for  the  remaining  three  quadrants. 

We  need  to  show  that  R2  — (0,0)  is  reachable  from  any  point  x0  in  R2  — (0,0). 
The  positive  x,  axis,  the  positive  x2  axis,  the  negative  x,  axis,  and  the  negative  x2 
axis  are  all  integral  curves  of  g.  The  vector  field  /  points  towards  the  first 
quadrant  along  the  positive  x,  axis,  towards  the  second  quadrant  along  the 
positive  x2  axis,  towards  the  third  quadrant  along  the  negative  x,  axis,  and 
towards  the  fourth  quadrant  along  the  negative  x2  axis. 

Thus  we  are  able  to  move  from  one  quadrant  to  the  next  by  using  the  / 
vectors.  Since  each  quadrant  is  controllable,  the  system  is  controllable,  ignoring 
the  point  (0,0). 


n*.  i 
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Example  2.6.  Let 
i(/)- 


*i(') 

*2(0 


0  1 

x, 

+  u(t ) 

'  1  0 

*1 

1  0 

*2. 

0  4 

1 

+  «<*) 


4jc, 


-AxO))  +  u(t)g(x(t)). 

where  x(0) ■r0€RJ- (0, 0). 


The  point  (0,0)  is  a  common  equilibrium  point  of  /  and  g.  Points  where  / 
and  g  are  linearly  dependent  are  given  by  x,*‘2x2  and  Jr,**  —  2x2-  As  in  the 
preceding  example,  each  often  quadrant  is  controllable  since 


0  f 

x\ 

1  0 

'  * 2 ' 

*2 

.  1  0. 

*X2 

.0  4 

*! 

J 

—  X, 

However  along  the  positive  x,  axis  (an  integral  curve  of  g),  f  points  towards 
the  first  quadrant,  and  along  the  positive  x2  axis  (an  integral  curve  of  g),/  points 
towards  the  first  quadrant  also. 

Thus  once  we  reach  the  first  quadrant,  we  cannot  leave  it  by  Theorem  2.1. 
This  system  is  not  globally  controllable. 
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Example  2.7\J].  Let 

*1 
*s 


-  Ax(t))  +  u(t)g(x( /)), 
where  x(0)  “  x0  G  R2  -  (0, 0). 

The  point  (0,0)  is  a  common  equilibrium  point  of  / and  g.  The  vector  fields / 
and  g  are  linearly  dependent  when  x2  +  x|  =  0,  i.e.  at  the  point  (0,0)  only. 

The  positive  x,  axis  and  the  positive  x2  axis  are  both  integral  curves  of  g. 
Along  the  positive  x,  axis/ points  toward  the  first  quadrant,  and  the  same  is  true 
for  the  positive  x2  axis.  By  Theorem  2.1,  this  system  is  not  controllable.  If  we 
restrict  our  attention  to  any  one  of  the  open  quadrants,  we  find  it  also  is  not 
controllable  by  Theorem  2.1.  This  occurs  because  an  integral  curve  of  g,  say  in 
the  first  quadrant,  disconnects  the  first  quadrant.  Moreover,  along  such  a  curve  / 
points  in  the  direction  of  one  of  the  components  bounded  by  the  integral  curve. 

The  above  examples  serve  to  show  the  practical  applications  of  Theorem  2.2 
together  with  Theorem  2.1. 


x{t) 


x20) 


0  1 

*1 

+  u(t) 

1  0 

* 

1  0 

1 

.  x2 

0  -1 

u(t) 


III.  Other  Problems 

We  can  of  course  ask  if  the  sufficient  condition  concerning  [/,g]  in  Theorem  2.2 
for  the  system  (2.2)  to  be  controllable  is  also  necessary.  It  is  known  in  the  linear 
case  that  it  is  necessary.  We  show  later  in  this  section  an  example  of  a  nonlinear 
system  which  is  controllable  but  for  which  the  condition  on  [f,g]  and  g  does  not 
hold. 

First  we  state  some  necessary  conditions  for  controllability,  which  do  not 
involve  computations  of  [/,$].  For  an  example  of  an  application  of  the  following 
theorem,  take  the  system  of  Example  2.7  restricted  to  the  open  first  quadrant  in 
R2. 

Theorem  3.1.  Assume  that  our  connected  real-analytic  2-dimensional  manifold  M 
is  also  simply  connected.  If  there  exists  an  integral  curve  of  g  which  disconnects  M 
and  which  does  not  intersect  the  set  of  points  where  f  and  g  are  linearly  dependent, 
then  the  system  (2.2)  is  not  controllable. 

Proof.  Suppose  this  integral  curve  of  g  gives  us  two  connected  open  compo¬ 
nents  O  and  O'  in  M.  Since  M  is  connected  and  simply  connected,  if  /  points  in 
the  direction  of  O  at  some  points  along  the  curve  and  in  the  direction  of  O'  at 
other  points  along  the  curve,  then  there  must  be  a  point  p  in  this  integral  curve 
where  /  and  g  are  linearly  dependent,  a  contradiction.  By  Theorem  2.1,  if  we 
assume  /  points  towards  O  on  the  integral  curve  of  g,  then  M  is  not  reachable 
from  any  point  x0  in  O.  □ 
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Returning  to  our  question  concerning  the  necessity  of  the  sufficient  condi¬ 
tion  in  Theorem  2.2,  we  offer  the  following  three  examples.  In  the  first  two,  [/,g] 
is  a  multiple  of  g  at  all  points  where  /  and  g  are  linearly  dependent  and  the 
systems  are  not  controllable.  The  third  example  involves  a  controllable  system  in 
which  [f,g\  is  a  multiple  of  g  at  all  points  where  /  and  g  are  linearly  dependent, 
showing  our  sufficient  conditions  are  not  necessary. 


Example  3.1.  Consider 

1  0 
0  1 


“/(*('))  +  u(t)g(x{l)), 
x(0)  -  x0e  R2  -  (0,0). 


*0) 


*i(') 

*2(0 


+  U(t) 


+  «(0 


*1 

*2 


The  set  of  points  in  R2  where  /  and  g  are  linearly  dependent  are  given  by 
x2—  x,  and  x2—  -  x,.  Also  (0,0)  is  a  common  equilibrium  point  of  / and  g.  The 
Lie  bracket 


[/•*] 


K  - 

0  1 

■*! 

+ 

1  0 

'*2 

9B 

0 

.  1  0. 

.*2. 

.0  1. 

x' 

.0. 

and  there  is  no  hope  of  using  Theorem  2.2. 

Disregarding  the  point  (0,0)  the  set  of  points  where  x,  =x2  is  a  common 
integral  curve  of  /  and  g  (it  is  this  type  of  behavior  that  occurs  in  a  noncontrolla- 
blc  linear  system  in  R2).  The  set  of  points  in  R2  where  x,  =  x2  disconnects  R2 
and  /  points  in  the  direction  of  this  set  when  x,  —  x2.  By  Theorem  2.1,  there  is  no 
way  of  moving  from  one  side  of  the  line  x,  =  x2  to  the  other,  and  we  cannot  have 
controllability. 


Example  3.2.  Consider  the  nonlinear  system 


x(r) 


(0 


+  “(') 


-  /W0)  +  «(0*W0). 


x(0)  -  x0  6  R2. 


We  show  that  this  system  is  not  controllable,  but  the  reasons  given  cannot  occur 
in  the  linear  case  as  in  Example  3.1. 

The  line  x2  — 0  is  the  set  of  points  where  /  and  g  are  linearly  dependent. 
Computing 


[/•*] 


IT  r2  1 
x2 

+ 

[0  2xj  1 

-2x1 

m 

-6x2 

1 

o 

o 

1 

0 

which  vanishes  on  x2  »■  0,  and  Theorem  2.2  is  not  applicable. 
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The  integral  curve  of  the  system  x(0“S(*(0)  through  (0,0)  is  given  by 
x3 

x,  —  -j-,  and  the  integral  curve  of  the  system  x(0"/(Jt(0)>  through  (0,0)  is  given 

_  2xi 

by  x,  -  — .  These  integral  curves  intersect  only  at  the  point  (0,0)  where  they 

have  a  common  tangent.  The  integral  curve  of  g  through  (0,0)  separates  R2  into 
two  connected  open  components,  and  /  points  towards  only  one  of  these 
components  along  the  integral  curve  near  (0, 0)  and  hence  along  the  entire  curve 
for  g  (except  at  (0,0)).  There  is  one  side  of  this  integral  curve  from  which  we 
cannot  move  to  the  other,  showing  the  system  is  indeed  not  controllable. 


Example  3.3.  Let 


x(t) 

*(0) 


4- 

— ~i 

i 

A. 

*l(t) 

M 

•t-  U\l) 

L  >  J 

-  x0  e  R2. 


- f{x(t))  +  u(t)g(x(t )), 


The  straight  line  x2=**0  defines  the  set  of  points  where  /  and  g  are  linearly 
dependent.  Computing 


[/•*] 


ri« 

>< 

CO 

O 

_  r3 
x2 

+ 

0  —  3x2 

*2 

6x2 

o 

o 

l 

0  0 

.  1  . 

0 

which  is  not  linearly  independent  from  g  when  x2-0.  If  we  take  the  integral 
curve  of  /  and  the  integral  curve  of  g  through  any  point  p  on  the  line  x2«0,  we 
find  the  differences  of  these  curves  (with  x,  as  a  function  of  Xj)  has  a  maximum 
at  the  point  p.  This  is  exactly  the  desired  behavior  we  need  for  the  vector  field/ 
to  “turn  through”  the  integral  curve  of  g  at  such  points.  Hence  along  any 
integral  curve  of  g  the  vector  field  /  points  in  the  direction  of  one  component 
(given  by  the  integral  curve  of  g)  at  some  points  and  in  the  direction  of  the  other 
component  at  different  points.  Then  this  system  is  controllable  despite  the 
relationship  of  [f,g]  and  g  when  x2=»0. 

This  last  example  suggests  the  existence  of  some  “higher  order”  sufficient 
conditions  for  controllability  which  may  also  be  necessary.  Hermes  [4]  has 
“higher  order”  conditions  for  the  local  controllability  problem.  Two  other 
immediate  problems  are  suggested.  Find  a  Theorem  2.2  which  implements 
Theorem  2.1  for  hypersurface  systems  in  the  case  where  the  dimension  of  the 
manifold  M  is  greater  than  two.  Find  a  Theorem  2.2  to  implement  the  controlla¬ 
bility  theory  in  [7]  and  [8]  for  general  nonlinear  systems  of  the  form  (see  (1.1)) 


*(')-/(*(')) +2  «%(/)*(*( 0),*0>) 

I- 1 


M. 


Professor  D.  L.  Elliott  has  pointed  out  to  the  author  a  paper  of  Y.  Gerbier 
[3],  Gerbier  shows  that  controllable  systems  of  two  vector  fields  in  R2  without 
equilibria  are  topologically  equivalent  (in  a  sense  defined  in  his  paper)  to 

I  d  9  A  a  \ 

(ax’  3x  9y  )• 
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Abstract 


tegral  curves  of  Bx  that  approach  the  origin. 


Consider  the  system 

x ( t )  -  f (x(t))  +  u(t)g(x(t)),  x(0)  -  xqcF2, 


We  Illustrate  our  method  by  applying  it  to  several 
examples.  Results  on  controllability  are  useful  in  the 
study  of  the  problem  of  stabilization.^ 


2 

where  f  and  g  are  real-analytic  vector  fields  on  R 

which  are  linearly  independent  at  some  point  of  R  ,  and 
u  is  a  real-valued  control.  Sufficient  conditions  on  f 
and  g  are  known  so  that  this  system  is  controllable 
from  Xq.  The  purpose  of  this  article  is  to  implement 
these  conditions  in  the  bilinear  case 

2 

x(t)  *  Ax(t)  +u(t)Bx(t),  x(0)  *  Xq  g  R  , 

where  A  and  B  are  constant  2  *  2  matrices.  The  process 
involves  finding  the  sec  of  points  where  Ax  and  Bx  are 
linearly  dependent  and  computing  the  Lie  bracket  [Ax, 
Bx]  at  all  such  points.  This  is  a  generalization  of 
the  well  known  controllability  results  for  a  linear 
system  on 


1 .  Introduction 


We  are  interested  in  the  system 
x(c)  -  f  (x(t))  +  u(c)g(x(c)) ,  x(0)  «  xqeM,  (1) 

where  M  is  a  connected  real-analytic  2-dimensional  man¬ 
ifold,  f  and  g  are  real-analytic  vector  fields  on  M, 
and  u  is  a  control.  In  examining  the  controllability 
of  this  system  from  x^ ■  the  important  item  to  check  is 
the  directiq^  of  the  vector  field  f  along  the  integral 
curves  of  g.'  We  assume  that  f  and  g  are  linearly  in¬ 
dependent  at  some  point  of  M  and  that  the  Lie  algebra 
L,  generated  by  f,g  and  successive  Lie  brackets  has 
vector  space  dimension  2  at  x^.  The  points  of  interest 
are  those  where  f  and  g  are  linearly  dependent  and  g  is 
nonzero.  If  every  integral  curve  of  g  which  is  non¬ 
trivial  has  such  a  point,  and  the  Lie  bracket  (f,g)  and 
g  are  linearly  independent  for  at  least  one  such  point 
on  each  integral  curve,  then  the  system  (1)  is  control¬ 
lable  from  any  point  Xq  with  the  vector  space  dimension 
of  La  at  Xg being  2 ,2  There  may  be  a  closed  nowhere 

dense  subset  of  M  which  is  not  reachable  from  x^,  and 
controllable  means  controllable  modulo  such  points. 


We  restrict  our  attention  to  the  bilinear  system 
x(c)  *  Ax(c)  +  u(t)Bx(t) ,  x(0)  «  XjjCR2,  (2) 


where  A  and  8  are  constant  2*2  matrices.  First  we 
compute  the  set  of  points  S  where  Ax  and  Bx  are  lin¬ 
early  dependent.  If  there  exists  an  integral  curve  of 
Bx  which  disconnects  R2  and  which  does  not  intersect 
S,  then  the  system  (2)  is  not  controllable.2  Next  we 
compute  the  Lie  bracket  [Ax.Bx]  at  all  points  where  Ax 
and  Bx  are  linearly  dependent  except  the  origin.  This 
computation  yields  a  constant  (along  each  manifold 
part  of  an  algebraic  variety)  which  if  nonzero  can  in¬ 
dicate  we  have  controllability.  .It  remains  only  to 
check  the  direction  of  the  vector  field  Ax  on  the  in- 


2.  Def inltions  and  Resul ts 
2 

If  X  is  a  vector  field  on  R  ,  then  a  is  an  integral 
curve  of  X  if  a  maps  the  closed  interval  ICR  into  R-  so 

that  ^77^-  *  X(a(t))  for  all  tel.  If  D  is  a  set  of 
dt  2 

vector  fields  on  R  ,  then  an  integral  curve  of  D  Is  a 
mapping  a  from  a  real  interval  ( t , t  ’ )  into  R^~ such  that 

there  exist  t  >  t.<t.<...<t,  •  t '  and  vector  fields 
0  k 

X^ . Xk  in  D  with  the  restriction  of  a  to  ft 

being  an  integral  curve  of  X^,  for  each  i  ”  1 ,2  ,. . .  ,k.  The 
set  D  we  consider  is  the  one  determined  by  the  vector 
fields  in  the  bilinear  system  (2). 


A  point  x  E R“  is  reachable  from  x^  if  there  is  an 

integral  curve  a  of  D  and  some  T  >  0  in  the  interval  for 
a  such  that  a(0)  *  xQ  and  a(T)  *  x.  A  subset  of  R2  is 

reachable  from  x^  if  every  point  in  this  set  is  reach¬ 
able  from  x„.  We  shall  make  assumptions  so  that  an  open 

subset  of  RZ  is  reachable  from  x  for  (2)  ,  and  the  lar- 
2  U 

gest  open  subset  U  of  R  which  is  reachable  from  x  is 

0  2 

called  the  region  of  reachability  from  x^.  If  U  *  R  , 

we  say  that  the  system  is  controllable  from  x  ,  and  con- 

2  3 

trollability  from  every  point  x^  E  R  gives  us  a  control¬ 
lable  system. 

2 

Let  0  be  an  open  subset  of  R  and  let  x  £  30.  The 
vector  field  f  points  in  the  direction  of  5,  or  towards 
0,  at  *  if  there  is  an  open  neighborhood  W  of  x  in  R- 
such  that  the  integral  curve  of  f_starting  at  x  and  in¬ 
tersected  with  W  is  contained  in  0.  In  addition  if  30 

is  £  near  x  and  f(x)  is  not  tangent  to  30  at  x ,  then  f 
points  in  the  direction  of  0,  or  towards  0,  at  x.  If  f 
points  in  the  direction  of  0  (or  0)  for  all  x  £  30,  then 
f  points  in  the  direction  of  S  (or  0)  on  30. 

If  h^  and  h^  are  vector  fields  on  R2 .  the  Lie 
bracket  of  h^  and  h ^  is  defined  by 


3h2 

[hl’V  "  3x  hl  " 


3h 

3^V 


3h  3h2 

where  -r —  and  -z —  denote  Jacobian  matrices.  Of 
3x  3x 

other  Lie  brackets  like  [h^  ,  [h^  .h^] ]  , . . .  can  be 


course 
taken . 


The  Lie  algebra  generated  by  Ax,  Bx,  and  successive 
Lie  brackets  is  denoted  by  L^. 


Our  first  result  concerns  the  region  of  reachabil¬ 
ity  of  our  system  (2).  It  is  proved  for  s  hypersurface 
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system  of  dimension  n. 

Theorem  l.  Assume  the  vector  space  dimension  of  L^  at 

is  2  and  chat  Ax  and  Sx  are  Linearly  independent  at 
0  2 

some  point  of  R  .  Let  U  be  the  smallest  open  subsec  ot 
R2  with  Xg  £  U  satisfying  3U  contains  the  integral 

curves  of  Bx  which  intersect  it  and  Ax  points  in  the 
direction  of  U  on  U.  Then  U  is  the  region  of  reach¬ 
ability  from  Xg  for  our  system  (2). 

Ic  is  our  goal  to  implement  the  following  theorem, 
which  has  been  proved  for  a  general  nonlinear  system  in 
*1  2 
two  dimensions.'  Here  V  is  a  domain  in  R  ,  and  Che 

statement  is  for  our  bilinear  system. 

Theorem  2_.  Assume  that  Ax  and  Bx  are  linearly  indepen¬ 
dent  at  some  point  in  V.  Suppose  every  incegral  curve 
of  Bx  which  disconnects  V(V-{(0,0)}  if  (0,0)  is  in  V) 
concains  a  point  where  Ax  and  Bx  are  linearly  dependent 
and  [Ax,Sx]  and  Bx  are  linearly  independent.  Then  the 
system  (2)  is  controllable  on  V  from  any  point  t V 
such  thac  the  vector  space  dimension  of  LA  at  Xq  is  2. 

3.  Computation  of  Lie  Brackets 

Me  compuce  [Ax,Bx]  at  all  polncs  (except  (0,0)) 
where  Ax  and  Bx  are  linearly  dependent.  Let 

. .  f*u  ah  „ .  hi  bh 


-e2VVC2-Sg3 


A  *  and  B  ™  K  , 

t®21  a22J  [b21  b22 ) 

Then  Ax  and  Bx  are  linearly  dependent  on  the  algebraic 
variety  given  by 

dechlXl  *  *12X2  bUXl  +  b12X2]  .  Q 
[a21x2  +  a21x2  b21xl  +  b22x2j 

l.e.  (aub21  -  anbu)x2l  H-  (.ub22  +  -  «abl2  - 


a22bUJXlX2 


)x,  x,  +  (a,,b 


a,„b,,)x. 


1222  22  12  2 
all"  a21bll  ’ 


0.  Let 


allb22  +  a12b21  '  a21b12"  a22bll  *  C2 
a12b22  ‘  a22b12  “  C3 ’ 

Then  we  have  no  nonzero  real  solutions  (x^.x,)  if  and 
only  If  (  ,  ) 


Thus  we  assume  thac  this  determinant  is  <  0. 


If  c^-Cj-Cg-O,  then  Ax  and  Bx  are  linearly  de¬ 
pendent  everywhere,  contrary  to  our  assumptions  of 
Theorems  l  and  2.  If  c^  •  0  and  ac  laaat  on*  of  c2  and 

Cg^O,  then  Ax  and  Bx  are  linearly  dependent  on  the 
lines  x2*0  and  c2*i  +  c3*2  ”  0 '  Similarly,  if  •  0 
aid  at  least  one  of  c^  and  c^O,  than  Ax  and  Bx  are 
linearly  dependent  on  the  lines  •  0  and  c2xi  +  c2x2*^' 
If  boch  c^  and  c^  *  0  and  c^O,  then  Ax  and  Bx  are 
linearly  dependent  when  x^«0  end  x2»0.  Finally,  if 
and  Cj^O,  then  Ax  and  Bx  are  linearly  dependent 


.  Hence  there  are  four  cases  we 


must  consider. 

Computing  we  find 


[Ax  ,Bx]  -  - 


hi  a12  buVb12x2Ubll  bn]hlXl+a12X 


[*21  a2 2 j  ib21Xl'H’22x2j[b21  b22 j  (a21xl+a22X2 j 
allb12X2+a12b21Xl+a12b22X2*,12bllx2'a21b12xra22bli'2 

a21bllXl+a21b12x2+a22b21Xl*allb21xl‘a12b21X2'a21b2?l 


We  are  given 


bllXl  +  b12X2 
b21Xl  +  b22X2 


d  »  deiaUb12X2+ai2b21xl+a12b22X2"a12bllX2'a21b12Xl 
la21bllxl+a21b12X2+a22b21XraUb21Xra12b21Xl 


-a22b12x2  bUXl  +  b12X2| 
-a21b22Xl  b21xl  +  b22x2|' 


Case  I.  c^  •  0  and  ac  lease  one  of  c2  and  c^#0. 

Plug  x2 *  0  into  d  and  factor  out  x^  to  get  a  con- 

1  C3  C2 

stant  d+,  and  plug  x^  -  -  if  +  0  (or  x^-^-x^ 

c.  ^0)  Into  d  and  factor  out  x.  (or  x  )  to  get  a  con- 

1  L  1 

stant  d_. 

Case  2.  c^  ■  0  and  at  least  one  of  and  c^O. 

Plug  x^  m  0  Into  d  and  factor  out  x^  to  get  a  con- 

2  C2  C1 

scant  d.  ,  and  plug  x ,  - **,  if  c,  f  0  (or  x,  - x, 

+  1  Cj  2  1  2  c2  1 

if  c2  i  0)  inco  d  and  factor  out  x2  (or  x^)  to  get  a 
cons  t  ant  d2 . 

Case  3.  c^"Cj"0  and  c^  +  0. 

Plug  x  ”0  Into  d  and  factor  out  x.  to  get  a  con- 

3  1  i 

stant  d.,  and  plug  x,  “  0  Into  d  and  factor  out  x  to 

3  2  1 

get  a  constant  d_. 

Case  it ■  and  c^O. 

x2  [~2 

Plug  x  •  i — (-c,  +yc  -ic.c  )  Into  d  and  factor  out 

1  tC.  i.  i  L  J 

1  4 

x2  to  get  a  const  ant  d+,  and  plug  x^  •  (-c2  - 

(~ J  ^ 

yCj-Ac^Cj)  Into  d  and  factor  out  Xj  to  get  a  constant 


Our  next  result  follows  directly  from  Theorem  2. 
Again  V  is  e  domain  in  R. 

Theorem  1.  Suppose  Ax  and  Bx  are  linearly  Independent 
at  some  point  in  V.  Assume  that  every  Integral  curve 
of  Bx  which  disconnects  V(V-{(0,0)}  if  (0,0)  is  in  V) 
contains  a  point  whera  Ax  and  Bx  are  linearly  dependent 

and  that  d~  and  d^  are  boch  nonzero  If  we  are  under 

case  i,  i  •  1,...,4.  Than  the  system  (2)  Is  control¬ 
lable  on  V  from  any  poinc  x^  i  V  such  that  the  vector 

space  dimension  of  L^  at  x^  Is  2. 
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1 


i.  Exarp I es 

We  anply  Theorems  1,  2  and  3  to  the  following 
three  examples. 


Example  K  Let 
x(t) 


xi]  _  {0  i 

K 

+  u(t) 

'1  o' 

V 

x2|  [l  0 

hJ 

.0  -1. 

*2. 

Ax(t) + u(t)Bx(t) ,  x(0) 


xQ  £R 


{(0,0)}. 


The  vector  fields  Ax  and  Bx  are  linearly  dependent 
2  2 

only  on  Che  set  S  defined  by  x^ + x^  ■  0,  i.e.  at  the 

origin  (0,0).  Any  Integral  curve  of  Bx  In  the  open 
first  quadrant  disconnects  R^  and  does  not  Intersect  S. 
By  a  statement  In  Che  Introduction  (which  follows  from 
2  3 

Theorem  1  ),  this  system  Is  not  controllable  from 

2 

every  x^eR  -{(0,0)},  even  though  the  vector  space  di¬ 
mension  of  l.  at  each  such  x.  Is  2. 

A  0 


Example  2^  Let 


x(t) 


x^t) 

x2(t) 


0 

1 


1 M 

°J[x2j 


+ 


u(t)  o 


0 

4 


-  Ax(t)  +  Bx(t),  x(0)  -  xQ  eR2  -  {(0,0)}. 


The  set  S  of  points  where  Ax  and  Bx  are  linearly 
dependent  is  given  by  x^  ■  2x^  and  x^  « -2Xj  and  we  are 

in  case  4.  We  find  d^  *  -24  on  x^ * 2x^  and  d^ * -24 

on  x  *  -2x  .  Applying  Theorem  3  with  V  equal  to  the 
A  1  2 

open  first  quadrant  In  R  shows  that  this  quadrant  is 
controllable  for  the  system.  The  same  is  also  true  for 
the  second,  third,  and  fourth  open  quadrants  in  R  . 


negative  x^-atis,  mid  the  negative  x^-mls  are  all  In¬ 
tegral  curves  of  Bx.  The  vector  field  Ax  points  towards 
the  first  quadrant  along  the  positive  x^-mtls  ,  towards 

the  second  quadrant  along  the  positive  x^-atis,  towards 
the  third  quadrant  along  the  negative  x^-axls,  and  to¬ 
wards  the  fourth  quadrant  along  the  negative  x^-axis. 

Thus  we  are  able  to  move  from  one  .quadrant  to  the  next, 

2 

and  our  system  is  controllable  on  R  -{(0,0)}. 
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Since  the  positive  x^axis  and  the  positive  Xj- 

axis  are  integral  curves  of  Bx,  and  since  Ax  points  to¬ 
ward  the  open  first  quadrant  along  these  two  curves  and 
is  zero  at  the  origin.  Theorem  1  implies  that  our  sys¬ 
tem  is  not  controllable  for  R2-{(0,0)}.  Once  we  are 
in  the  open  first  quadrant,  it  is  impossible  to  leave 
it. 


2  Even  in  this  example  which  is  not  controllable  on 
R  -{(0,0)},  our  theory  and  technique  give  us  much  in¬ 
sight  into  the  behavior  of  the  system  under  controls. 


Example  3.  Let 


Xjft) 

H 

1 

O 

X1 

x2(t) 

|  M 

1  0 

X2. 

»  Ax(t)  +u(t)Bx(t),  x(0)  - 


+  u(t) 


XqCR 


fi  0] 

*1 

O 

1 

*2 

- {(0,0)}. 


The  set  S  where  Ax  and  Bx  are  linearly  dependent 
is  given  by  x^  »  2x2  and  x^'^Xj.  Also  the  vector 

space  dimension  of  L,  at  each  point  of  R2  -  {(0,0)}  is 

2.  A 


We  apply  Theorem  3  to  the  open  first  quadrant. 

Any  integral  curve  of  Bx  which  starts  in  the  first 
quadrant  intersects  the  line  x^  *  2Xj.  Since  d*  ■ +40 

on  x^  ■  2X2,  the  first  quadrant  is  controllable  from 
any  x^  in  it.  Similar  arguments  show  that  each  of  the 
other  three  quadrants  is  also  controllable. 

The  positive  x^-axis,  the  positive  Xj-axis,  the 
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CONTROLLABILITY  AND  STAB ILIZ ABILITY 
L.  R.  Hunt 

Department  of  Mathematics 
Texas  Tech  University 
Lubbock,  Texas  79409 


ABSTRACT 

Consider  the  system 

x(t)  *  f (x(t))  +  u(t)g(x(t))  ,  x(0)  «  xqcR2, 

where  f  and  g  are  real-analytic  vector  fields  on 
ft  .  If  this  is  a  controllable  linear  system,  then 
it  Is  well  known  the  system  is  stabilizable  by 
linear  feedback.  We  want  to  consider  a  similar 
problem  for  nonlinear  systems,  with  emphasis  on 
bilinear  systems.  Sufficient  conditions  for  the 
above  system  to  be  controllable  have  been  found, 
and  implementation  for  bilinear  systems  has  been 
discussed.  If  a  bilinear  system  is  controllable 
under  these  conditions,  we  show  that  we  can  move 
2 

from  any  point  x^cR  -  {(0,0)}  to  the  origin. 

1.  INTRODUCTION 


2 

in  R  such  that  the  integral  curve  of  f  starting 
at  x  and  intersected  with  '*  is  contained^in 
0.  Here  0  denotes  the  closure  of  0  in  R*.  In 
addition  if  30  is  C^  near  x  and  f(x)  is  not  tan¬ 
gent  to  30  at  x,  then  f  points  in  the  direction 
of  0,  £r  toward  0,  at  x.  If  f  points  toward  0 
(or  0)  for  all  x  e  30,  then  f  points  in  the  direc¬ 
tion  of  0  (or  0)  on  30. 


The  Lie  bracket  of  the  vector  fields  f  and  g 
is  defined  by 

If  .el  -  Ilf  -  II*. 


where  and  -r~  denote  Jacobian  matrices.  Other 

(jX 


Lie  brackets  [f.Jf.g]] ,  [g , [ f ,g! ] , . . .  can  also  be 
taken.  The  Lie  algebra  generated  by  f,  g,  and 
successive  Lie  brackets  of  f  and  g  is  denoted  by 


L 


A- 


If  the  system 

x(t)  •  f(*(t»  +  u(t)g(«(t)),  x(0)  *  xQ  £  R2,  (1) 

where  f  and  g  are  real-analytic  vector  fields  on 

R^,  is  a  linear  system,  then  the  relationship  be¬ 
tween  controllability  and  stabilitability  are  known 
[14],  For  nonlinear  systems  there  are  some  results 
on  "controlled  stability"  [2].  Recently,  theorems 
giving  sufficient  conditions  for  the  system  (1)  to 
be  controllable  have  been  proved  [9]  and  imple¬ 
mented  in  the  bilinear  case  [10]. 

For  the  bilinear  system 

x(t)*Ax(t)+u(t)Bx(t),  x(0)*x0cR^-{(0,0)},  (2) 

where  A  and  B  are  constant  2*2  matrices,  we  show 
chat  these  sufficient  conditions  for  controlla¬ 
bility  imply  that  we  can  choose  controls  to  drive 
from  the  point  xQ  towards  the  origin  along  the 

solution  curves  corresponding  to  these  controls. 
Since  we  are  presently  interested  in  only  qualita¬ 
tive  results,  we  assume  that  It  is  possible  to  move 
along  the  Integral  curves  of  the  vector  field  Bx 
if  necessary. 

Two  examples  are  used  to  illustrate  our  method. 
2.  RESULTS 


Theorem  1^  Assume  that  Ax  and  Bx  are  linearly 
independent  at  some  point  in  V.  Suppose  every 
integral  curve  of  Bx  which  disconnects  V(V-{(0,0>) 
if  (0,0)  is  in  V)  contains  a  point  p  where  Ax  and 
Bx  are  linearly  dependent  and  [Ax.Bx]  and  Bx  are 
linearly  independent.  Then  the  system  (2)  is 
controllable  on  V  from  any  point  x^eV  such  that 

the  vector  space  dimension  of  L^  at  x^  is  2. 

Thus  under, the  above  assumptions  we  can  reach 
any  point  in  V(V-[(0,0)}  if  (0,0)  is  in  V)  from 
x_  by  choosing  a  finite  number  of  controls  and 
following  the  solution  curves  of  the  corresponding 
differential  equations. 


We  give  the  following  definitions,  where  f  and 
g  are  the  vector  fields  from  system  (1). 

2 

Let  0  be  an  open  subset  of  R  and  let  x  £  3CL 
Then  f  points  in  che  direction  of  0,  or  towa rd  0, 
at  x  if  there  exists  an  open  neighborhood  W  of  x 


Let  us  understand  the  geometric  meaning  of 
the  Lie  bracket  [Ax,Bx]  and  the  vector  field  Bx 
being  linearly  independent  at  p  [9],  There  is  an 
open  neighborhood  W  of  p  in  V  such  that  the  inte¬ 
gral  curve  of  Bx  through  p  divides  W  into  open 
connected  components  W  and  W  and  f  points 
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coward  W  at  aLl  points  in  this  integral  curve  on 
one  side  of  p  and  toward  Wj  ac  all  points  in  this 
curve  on  che  ocher  side  of  p.  In  other  words,  the 
vector  field  f  "turns  chrough"  Che  integral  curve 
of  Bx  chrough  p  at  p. 

The  set  of  points  where  Ax  and  Sx  are  linearly 
dependent  is  the  algebraic  variety  S  defined  by 

A1(x)  3]/x>| 

det  I  »  0. 

AjCx)  B,(x)J 

The  interesting  case  occurs  when  we  have  an  alge¬ 
braic  variety  consisting  of  two  straight  lines  that 
incersecc  at  the  origin.  It  is  shown  that  the 
brackec  [Ax,3x]  and  che  vector  field  Bx  are  lin¬ 
early  independent  on  one  of  these  straight  lines  if 
and  only  if  a  computable  constant  (depending  on  the 
line)  is  nonzero  [10].  However,  we  do  noc  use 
those  computations  here  for  the  sake  of  brevity. 

Ve  want  to  applv  our  resulcs  on  controllability 

2 

co  prove  that  we  can  move  trom  poinc  x„  in  R  to 

2  ° 

che  origin  in  R  . 

Theorem  2.  Assume  that  Ax  and  Bx  are  linearly  in¬ 
dependent  at  some  point  in  R^  and  chat  the  vector 
space  dimension  of  L  is  2  ac  every  point  in 
2  ^ 

R  -  {(0,0)].  Suppose  every  integral  curve  of  Bx 
(or  -3x)  either  approaches  the  origin  or  discon¬ 
nects  R~  and  contains  a  poinc  p  in  c he  set 
S  -  ((0,0)}  where  [Ax.Bx]  and  Bx  are  linearly  inde- 
2 

pendent.  For  any  xQ  i  R  -  {(0,0)}  we  can  choose 

controls  co  drive  from  Xg  Co  (0,0)  along  che  solu¬ 
tion  curves  corresponding  co  these  concrols. 

Proof.  As  mentioned  previously,  we  assume  chac  we 
can  move  along  the  integral  curves  of  Sx.  If  Xg  is 
contained  in  one  of  these  curves  which  approach  che 
origin,  then  we  certainly  can  move  along  this  curve 
(either  in  forward  or  backward  cime  since  we  can 
concrol  Bx)  to  (0,0).  Thus  if  all  integral  curves 
of  Bx  approach  the  origin  we  are  through.  Other¬ 
wise,  we  have  chac  che  algebraic  variety  S  defined 

by 

A^(x)  B^(x) 

det  “  0 

A^ (x)  B^(x) 

consiscs  of  two  scraighc  lines  intersecting  at  the 
origin. 


pretation  of  the  linear  independence  of  [Ax,Bx] 
and  Bx,  there  is  an  open  neighborhood  VJ  of  p  in 
R^  such  that  Ax  points  coward  U  on  WO  C.  and 
(J2  on  UdCj.  1  1 


Take  a  line  L  through  the  origin  and  a  point 
PjeUDC  of  3lope  ra.  We  can  reach  p^  by  moving 

along  che  integral  curve  C  (if  Xg  is  in  W  Oc^, 

there  is  no  need  in  driving  from  Xg  to  a  point 
like  p^).  We  wish  to  move  from  p^  to  che  origin 

along  the  straight  line  L.  We  can  choose  the 
slope  m  so  chat 

i)  the  line  L  is  noc  in  the  set  S, 
ii)  mB^(x)  -  B^(x)  }  0  on  L. 

Condition  1)  is  obvious  but  condition  ii)  requires 
justif icacion .  The  sec  of  points  defined  by 
mB^(x)  -  B^Jx)  ■  0  is  a  straight  line  through  the 

origin  and  therefore  either  intersects  L  only  at 
(0,0)  or  coincides  with  L.  If  these  two  lines 
coincide  Chen  L  is  an  incegral  curve  of  3x  which 
intersects  C,  another  integral  curve  of  Bx,  crans- 
versally  at  p^,  a  contradiction. 


It  remains  to  take  che  concrol  u  in  our  sys¬ 
tem  (2)  to  move  from  p^  to  (0,0)  along  L.  Thus 

we  must  have  x.,  »  mx^  or  A.,(x)  +  uB^fx)  *  mA^fx) 

+  mu3^(x).  Solving  for  u  we  have 
A. (x)  -  mA  (x) 

u  “  S31ur-“B2(xT  • and  ”Vx)  -  Vx)  * 0  on  L- 


If  we  substitute  this  u  into  (2)  we  have 


Since  IhS  -  (0,0)  and  S  is  defined  by 

A^(x)  B^(x) 

det  *  0, 

A2(x)  B2(x) 


Suppose  Xg  is  contained  in  an  Integral  curve  C 

of  8x  which  disconnects  R^  and  Intersects  che  set 
of  points  S.  By  moving  along  this  integral  curve 
in  forward  or  backward  time,  we  can  reach  a  point 
p  C  S.  This  curve  C  divides  R^  into  two  open  con¬ 
nected  components  and  U2.  one  of  which,  say 

contains  che  origin.  The  point  p  divides  C  into 
two  components  and  C^.  By  our  geometric  incer- 


this  control  will  push  us  from  p^  to  (0,0).  Hence 
we  can  move  from  Xg  toward  (0,0) *by  moving  along  C 
to  p^  (if  necessary)  and  along  L  from  p^  co  che 

origin.  Q.E.D. 

3.  EXAMPLES 

It  is  well  known  that  all  controllable  linear 
systems  on  Rn  are  stabilizable  by  linear  feedback 
(Id).  Our  firsc  example  is  a  controllable  linear 
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2 

system  x  *  Ax  +  uB  in  R  .  We  use  the, ideas  of 
this  paper  to  move  from  a  point  x^ C R“{ (0 ,0) }  to 
the  origin  along  an  Integral  curve  of  B  (if  ne¬ 
cessary)  and  Chen  along  a  straight  line  to  the 
origin.  It  is  interesting  that  the  control  u  we 
choose  co  move  along  the  straight  line  is  a  linear 
feedback  control. 

Example  1_. 

'o' 

»Ax  +  uB,  x  eR  -  {(0,0)}. 

1 

The  integral  curves  of  B  are  vertical  lines  in 
the  (x^.Xj)  phase  plane.  The  set  S  uhere  Ax  and 

B  are  linearly  dependent  is  given  by  x,  *  0. 

Since  the  controllability  matrix  { 8, AE}  has  rank 
2  (this  is  equivalent  to  the  Lie  bracket  [Ax.B] 
and  the  vector  field  B  being  linearly  independent) 
our  system  is  controllable.  This  implies  that  Ax 
turns  through  an  integral  curve  of  B  at  the  point 
where  B  intersects  S. 

If  x  is  in  the  integral  curve  of  B  through 
(0,0),  we  simply  move  along  this  curve  to  (0,0) 

If  x  is  in  the  open  first  quadrant  or  the  posi¬ 
tive  x  axis  we  drive  along  the  integral  curve  of 
B  through  xQ  until  we  reach  the  open  fourth  quad¬ 
rant.  Then  we  choose  a  line  L  of  slope  m  and  the 
A, (x)  -  mA  <x) 

concrol  u  *  — - - -  ,  where 

[yx)|  fo 

Ax  *  j  and  B  *  , 

A2(x)j  |l 

to  approach  the  origin.  Since  A.,(x)  =  x^  and 
Aj(x)  «  Xj,  u  *  -Xj  +  mx,  is  simply  linear  feed¬ 
back. 

If  Xq  is  the  second  or  fourth  quadrancs  we 
simply  take  such  a  scraight  line  L  and  then  find 
our  control  u.  If  x.  is  in  the  third  quadrant  or 
in  the  negative  x^  axis  we  first  move  to  the  se¬ 
cond  quadrant  and  then  choose  our  line. 


Our  nexc  example  is  a  bilinear  system. 
Example  2.  Let 


X, 

0  1 

X, 

1 

• 

1 

♦  u 

*2 

1  0 

X2 

*1 

0 

-lj 

*1 
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c 
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o' 

fx 

X1 

*2 

1 

°J 

*2. 

0 

-4 

X2. 

-  Ax  +  uBx,  x(0)  «  xQ  CR2  -  {(0,0)}. 

The  set  S  of  points  where  Ax  and  Bx  are  de¬ 
pendent  is  defined  by  the  straight  lines  x^  *  2x^ 

and  x^  ■  -2x2-  The  Lie  bracket  [Ax.Bx]  and  the 

vector  field  Bx  are  linearly  independent  at  all 
points  in  S  -  {  (0,0)},  and  this  is  a  controllable 
svstem  [9).  The  vector  space  dimension  of  L.  at 

2  A 
all  points  of  R  -  {(0,0)}  is  2.  Also  the  integral 

curves  of  Bx  that  approach  the  origin  are  the  pos¬ 
itive  and  negative  x^  and  x^  axes.  All  other  in¬ 
tegral  curves  of  Bx  intersect  the  set  S  and  Theorem 
2  applies. 


If  Xq  is  not  contained  in  the  x^  axis  or  the 

x,  axis,  then  we  move  along  an  integral  curve  of 
Bx  to  the  "correct  side  of  S"  (if  necessary)  and 
choose  our  line  L  of  slope  m  through  the  origin. 

X1  +  mx2 

In  this  case  our  control  is  given  bv  - — -  , 

and  with  it  we  can  move  toward  the  origin. 


The  results  of  this  paper  for  bilinear  sys¬ 
tems  in  two  dimensions  should  generalize  to  more 
complicated  systems  in  higher  dimensions.  Of 
course  instead  of  moving  along  scraight  lines  we 
probably  will  want  to  move  along  certain  smooth 
surfaces.  The  development  of  a  theory  for  higher 
dimensional  problems  has  begun  [6}, (7), [8].  Sev¬ 
eral  important  papers  on  nonlinear  controllability 
1 1] ,  1 3] ,  [4] ,  [ 5] ,  [ 11] , [ 12] , [ 131  contain  results 
which  may  prove  useful  in  this  theory. 
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Abstract  of 


CONTROLLABILITY  OF  NONLINEAR  HYPERSURFACE  SYSTEMS 


L.  R.  Hunt 


Abstract 


Consider  the  nonlinear  system 

n-1 

x ( t )  =  f(x(t))  +  u,(t)g,(x(t)),x(o)  =  x  M 

i=l  1  1  0 

where  M  is  a  connected  real-analytic  n-dimensional  manifold,  f,g-|,...,g  -| 

are  real-analytic  vector  fields  on  M,  and  u-j,...un  -j  are  real-valued  controls. 
We  are  interested  in  characterizing  the  largest  open  subset  U  of  M,  if  any, 
which  is  reachable  from  xq  and  which  we  call  the  region  of  reachability  of 
our  system  from  xq.  If  the  Lie  algebra  generated  by  f ,g.| , . . . »gn_]  and 
successive  Lie  brackets  has  vector  space  dimension  n  at  xq,  and  if  g,g^,..., 
gn_1  are  linearly  independent  at  some  point  in  M,  we  find  the  region  of 
reachability  from  xQ.  Suppose  U  is  the  smallest  open  subset  of  M  with  xqeU 
so  that  3U  contains  the  integral  manifolds  of  the  Lie  algebra  L'A  generated 
by  g-|».-.,gn_-|  that  intersect  it  and  f  assigns  vectors  on  U  which  point  in 
the  direction  of  0".  Then  U  is  the  region  of  reachability  from  xQ  for  our 
system.  Much  of  the  work  is  involved  in  proving  a  similar  result  in  the  more 
general  C°°  case  under  the  stronger  assumption  that  f  ,g-| ,. . .  ,gp_i  are  linearly 
independent  on  the  connected  C°°  n-dimensional  manifold  M. 
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Abstract  of 

n-DIMENSIONAL  CONTROLLABILITY  WITH  (n-1)  CONTROLS 

L.  R.  Hunt 


■\ 


Abstract 


Let  M  be  a  connected  real-analytic  n-dimensional  manifold,  f,g,,...gn_i 
be  complete  real-analytic  vector  fields  on  M  which  are  linearly  independent 
at  some  point  of  M,  and  u-|,...,u  -|  be  real-valued  controls.  Consider  the 

control labil ity  of  the  system 

.  n-1 

x ( t )  =  f (x( t) )  +  l  u.(t)g1(x(t)),  x(0)  =  XqeM . 
i=l 

Necessary  and  sufficient  conditions  are  given  so  that  this  system  is  con¬ 
trollable  on  any  simply  connected  domain  D  contained  in  M  on  which 
g1$...,g  ^  are  linearly  independent.  These  conditions  depend  on  the 

computation  of  Lie  brackets  at  those  points  where  f ,g1 ....  *9n_-|  are  linearly 
dependent. 
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Abstract  of 

SUFFICIENT  CONDITIONS  FOR  CONTROLLABILITY 


L.  R.  Hunt 


* 


Abstract 

The  problem  is  to  find  sufficient  conditions  for  the  system 

m 

x ( t )  =  f ( x ( t ) )  +  u. (t)g. (x(t) ) ,  x(0)  =  Xn  M 
i=l  1  1  u 

to  be  controllable.  Here  M  is  a  connected  C“  n  dimensional  manifold, 
f.91.....gm  are  complete  vector  fields  C°°  vector  fields  on  M,  and  u-|,...,um 
are  real-valued  controls.  If  m  =  n  -  1 ,  M,  f ,  , . . .  ,g  ^  are  real-analytic, 

M  is  simply  connected,  and  g-j , .  - .  »3n_i  are  linearly  independent  on  M,  then 
necessary  and  sufficient  conditions  are  known.  For  the  case  of  our  C°° 
system  with  general  m,  we  assume  that  the  Lie  algebra  generated  by 
f,  g1,...,gm  and  successive  Lie  brackets  has  constant  dimension  p  on  M  and 
the  algebra  L^  generated  by  g^,...,gm  and  successive  Lie  brackets  has  constant 
dimension  p'  <  p  on  M.  If  p '  =  p ,  Chow's  Theorem  implies  controllability  for 
a  p-dimensional  submanifold  of  M  containing  Xg.  If  p'  <  p,  sufficient 
conditions  are  found  involving  the  computation  of  certain  Lie  brackets  at 
points  where  the  vector  field  f  is  tangent  to  the  integral  manifolds  of  L^. 
Here  we  assume  that  every  integral  manifold  of  L^  contains  such  a  point.  In 
many  cases  it  is  impossible  for  every  integral  manifold  of  L^  to  contain  a 
point  where  f  is  tangent  to  it.  Therefore,  we  illustrate  a  method  which  can 
yield  controllability  results  if  this  occurs. 
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Abstract  of 

CONTROLLABILITY  AND  TRANSVERSAL ITY 


L.  R.  Hunt 


Abstract 


Consider  the  system 

'  m 

x ( t )  =  f (x(t) )  +  l  u.(t)g.(x(t)),  x ( 0 )  =  x0  e  m, 
i=l  1  1  J 

where  M  is  a  c”  real  n-dimensional  manifold,  f,g^,  gm  are  C°°  vector 
fields  on  M,  and  u-,,...,  um  are  real-valued  controls.  For  linear  systems, 
it  is  known  that  the  controllable  systems  are  dense  in  the  set  of  all 
systems  on  Fn.  If  m  =  1  and  our  system  is  nonlinear,  this  is  not  true,  but 
it  is  shown  that  the  set  of  systems  whose  reachable  sets  contain  open 
subsets  of  M  is  dense  in  the  set  of  systems.  If  m  >_  2,  then  the  systems  which 
are  controllable  from  any  point  xQ  e  M  form  a  dense  set,  for  the  proper  topol¬ 
ogy,  in  the  set  of  all  such  systems.  The  technique  used  to  prove  the  last 
two  statements  involves  the  use  of  Thom  Tranversality  Theory. 

These  results  have  the  obvious  effect  in  applications.  In  modeling  by 
a  system  or  in  numerically  solving  a  system,  it  is  important  to  know  if  slight 
variations  in  a  system  or  approximations  of  a  system  by  other  systems  can 
radically  change  the  controllability  properties  of  the  given  system.  In  the 
literature  these  types  of  problems  are  found  in  the  study  of  structural 
stability. 


85 


Texas  Tech  Universit 


Institute  for  Electronic  Science 


Joint  Services  Electronics  Program  Research  Unit:  3 

1.  Title  of  Investigation:  Nonlinear  Fault  Analysis 

2.  Senior  Investigator:  Richard  Saeks  Telephone:  (806)  742-3528 

3.  JSEP  Funds:  Current  $24,650 

4.  Other  Funds: 

5 .  Total  Number  of  Professionals:  P I ' s  2  (3  mo.)  RA ' s _ 

6.  Summary: 

The  objective  of  the  research  program  is  the  formulation  of  commutation- 
ally  efficient  algorithms  for  fault  diagnosis  in  nonlinear  electronic  circuits. 
The  resultant  algorithm  will  be  implemented  in  the  form  of  two  software 
packages:  an  automatic  test  program  generator  (ATPG)  which  runs  in  a  main¬ 
frame  computer  and  a  fault  diagnosis  system  (FDS)  which  runs  in  an  appropriate 
minicomputer  based  automatic  test  set.  From  an  algorithmic  point  of  view 
the  primary  factor  underlying  the  design  of  the  fault  analysis  package  is 
that  the  ATPG  is  used  only  once  for  each  type  of  circuit  in  inventory  while 
the  FDS  is  used  each  time  a  circuit  of  that  type  fails.  As  such,  one  can 
justify  a  complex  and  long  running  ATPG  but  the  FDS  must  use  both  computer 
time  and  storage  efficiently.  The  goal  of  the  proposed  research  program  is, 
therefore,  the  formulation  of  fault  diagnosis  algorithms  which  can  be  run 
efficiently  in  this  dual  mode  environment  rather  than  simply  the  solution 
of  the  problem. 

7.  Publications  and  Activities: 

A.  Refereed  Journal  Articles 

1.  Saeks,  R.,  and  R.-w.  Liu,  "Fault  Diagnosis  in  Electronic  Circuits", 
Japan  Jour,  of  Electrical  Engineering,  (to  appear). 
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Conference  Papers  and  Abstracts 

1.  Wu,  C.-c.,  Sangiovanni-Vencentelli ,  A.,  and  R.  Saeks,  "A 
Differential-Interpolative  Approach  to  Analog  Fault  Diagnosis", 
Proc.  of  the  1981  IEEE  Inter.  Symp.  on  Circuits  and  Systems, 

(to  appear). 

2.  Wu,  C.-c.,  Nakajima,  K. ,  and  R.  Saeks,  "Post-Test  Fault  Simulation 
with  Failure  Limitations",  Proc.  of  the  24th  Midwest  Symp.  on 
Circuits  and  Systems,  (to  appear). 

Preprints 

1.  Wu,  C.-c.,  and  R.  Saeks,  "A  Data  Base  for  Symbolic  Network 
Analysis,  (submitted  for  publication). 

2.  Sangiovanni-Vencentelli,  A.,  and  R.  Saeks,  "Multi test  Diagnosi- 
bility  of  Nonlinear  Circuits  and  Systems",  (submitted  for  pub¬ 
lication)  . 

Theses 

1.  Hsieh,  M.,  "A  Fault  Diagnosis  Algorithm  for  Nonlinear  Circuits 
and  Systems",  Ph.D.  Dissertation,  Texas  Tech  Univ.,  1980. 

2.  Ngo,  Q.-d.,  "A  Dual  Mode  Fault  Diagnosis  Technique  for  Nonlinear 
Analog  Electronic  Systems",  M.S.  Thesis,  Texas  Tech  Univ.,  1980. 

3.  Wu,  C.-c.,  Ph.D.  Disseration,  Texas  Tech  Univ.,  (in  preparation). 

Conferences  and  Symposia 

1.  Saeks,  R.,  NSF  Workshop  on  Nonlinear  circuits  and  Systems, 

Rice  Univ. ,  Jan.  1980. 

2.  Saeks,  R.,  17th  Allerton  Conf.  on  Communications,  Control  and 
Conputing ,  Univ.  of  Illinois,  Oct.  1979. 

3.  Chao,  K.-s.,  1980  IEEE  Inter.  Symp.  on  Circuits  and  Systems, 
Houston,  May  1980. 

Lectures 

Saeks,  R.,  "Fault  Analysis  -  The  Missing  Circuit  Theory",  Univ.  of 

Notre  Dame,  Oct.  1979. 

Saeks,  R.,  "Fault  Diagnosis  -  The  Missing  Circuit  Theory",  Duke 

Univ. ,  May  1980. 
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A  Dif ferential -Interpol ative  Approach  to 
Analog  Fault  Simulation 

.  Wu,  A.  Sangiovam'-Vencentelli,  and  R.  Saefcs 


A  Differential-Interpolative  Approach  to 
Analog  Fault  Simulation 

C.-c.  Wu,  A.  Sangiovani-Vencentelli,  and  R.  Saeks 


Abstract 

After  a  half  century  of  neglect  by  the  circuits  and  systems  comnunity  the 
past  decade  has  witnessed  the  emergence  of  a  research  effort  in  the  analog 
circuit  maintenance  area.  The  various  algorithms  which  have  been  thus  far 
proposed  for  the  analog  fault  diagnosis  problem  may  naturally  be  subdivided 
into  two  classes  termed  "simulation-before-test"  and  "simulation-after-test". 
The  former  are  commonly  used  in  digital  system  test  algorithms  and  require 
an  automatic  test  program  generator  (ATPG)  which  simulates  the  responses  of 
"all  possible"  failures.  This  is  typically  done  at  a  maintenance  depot  with 
the  simulated  responses  being  recorded  and  shipped  to  the  field  where  the 
response  of  the  unit  under  test  (UUT)  is  compared  with  the  simulated  responses 
to  determine  the  failure.  The  major  advantage  of  simulation-before- test  is 
that  it  is  ideally  matched  to  the  depot/field  maintenance  environment  with  the 
largest  part  of  the  computation  done  only  once.  As  such,  the  technique  is 
ideally  suited  for  digital  testing  where  the  binary  nature  of  the  problem 
keeps  the  number  of  failures  to  be  simulated  within  bounds  and  eliminates 
tolerence  problems.  Unfortunately,  in  the  analog  problem  we  must  cope  with 
a  continuum  of  possible  failures  and  si:  '.neously  deal  with  good  components 

which  are  in  tolerance  but  not  nonr-  m.  uch,  a  tremendous  number  of  simu¬ 
lations  are  required  by  a  simulation-before-test  algorithm,  while  some  type 
of  decision  algorithm  is  required  to  cope  with  the  tolerance  effects. 

The  purpose  of  the  present  paper  is  to  describe  a  research  effort  directed  at 
alleviating  some  of  the  difficulties  in  developing  a  simulation-before-test 
algorithm  for  analog  fault  diagnosis. 
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Fault  Diagnosis  in  Electronic  Circuits 


R.  Saeks  and  R.-w.  Liu 
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Fault  Diagnosis  in  Electronic  Circuits 


R.  Saeks  and  R.-w.Liu 


Abstract 

The  state-of-the-art  in  analog  fault  diagnosis  is  surveyed.  The  specific 
economic  criteria  which  must  be  met  by  a  viable  fault  diagnosis  algorithm 
are  discussed  and  the  various  fault  diagnosis  algorithms  which  have  been 
proposed  are  reviewed  in  the  context  of  these  economic  constraints. 
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Post-Test  Fault  Simulation  with  Failure  Limitations 


C.-c.  Wu,  K.  Nakajima,  and  R.  Saeks 


Abstract 

Although  numerous  algorithms  have  been  proposed  for  fault  diagnosis  in 
analog  circuits  and  systems  they  may  naturally  be  subdivided  into  three  classes: 

i)  Simulation-before-test 

ii)  Simulation-after-test  using  a  single  test  vector 

iii)  Simulation-after-test  using  multiple  test  vectors 
At  the  present  time  none  of  the  three  approaches  has  been  shown  to  yield  satis¬ 
factory  performance.  Simulation-before-test  requires  an  extremely  costly  ATPG 
and  some  type  of  decision  algorithm  to  compensate  for  the  discretization  of 
component  parameters  and  tolerance  effects.  Simulation-after-test  using  a 
single  test  vector  circumvents  these  problems  but  requires  too  many  points 
while  one  must  solve  an  extremely  complex  set  of  nonlinear  equations  to  im¬ 
plement  a  simulation-after-test  algorithm  using  multiple  test  vectors. 

Unlike  the  simulation-before-test  algorithms,  simulation-after-test  al¬ 
gorithms  do  not  exploit  any  type  of  failure  limitation  assumption  restricting 
the  number  of  simultaneous  failures.  For  instance,  if  a  system  contains  100 
components,  but  it  is  assumed  that  no  more  than  3  fail  simultaneously,  such 
an  assumption  can,  at  least  conceptually,  reduce  a  100  dimensional  problem  to 
a  3  dimensional  problem.  The  open  question  is  to  find  trackable  methods  by  which 
to  exploit  such  an  assumption. 

The  purpose  of  the  present  paper  is  to  describe  a  new  single  test  vector 
simulation-after-test  algorithm  which  exploits  a  failure  limitation  assumption 
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to  bring  the  test  point  requirements  into  line  without  significantly  in¬ 
creasing  its  computational  complexity.  The  procedure: 

i)  is  applicable  to  both  linear  and  nonlinear  systems 

ii)  tests  a  system  up  to  any  specified  shop  replacable  assembly 

iii)  can  be  applied  to  a  sub-system  in-situe 

iv)  and  is  computationally  efficient  both  with  respect  to  ATPG  and 
on-line  requirements. 
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Oata  Base  for  Symbolic  Network  Analysis 


C,-c.  Wu  and  R.  Sacks 


A  Data  Base  for  Symbolic  Network  Analysis 


C.-C.  Wu  and  R.  Saeks 


Abstract 

Historical ly ,  symbolic  network  analysis  has  been  motivated  by  the  prob¬ 
lems  of  circuit  design  and,  as  such,  the  emphasis  has  been  placed"  on 
quickly  and  efficiently  obtaining  a  symbolic  transfer  function  from  a 
given  set  of  circuit  specifications.  In  an  operational  or  maintenance 
environment,  however,  one  is  typically  given  a  prescribed  nominal  circuit 
and  desires  determine  the  effect  of  various  (possibly  large)  perturbations 
thereon.  This  is  the  case  in  a  power  system  where  one  is  given  a  fixed 
network  and  desires  to  determine  the  effect  of  proposed  modifications  thereto. 
Alternatively,  in  the  problem  of  analog  circuit  fault  diagnosis  one  desires 
to  simulate  the  effect  of  a  number  of  alternative  failures  to  compare  the 
simulated  data  with  the  observed  failure  data. 

In  such  an  operational  or  maintenance  environment  numerous  perturbations 
of  the  nominal  circuit  are  studied  and,  as  such,  significant  computational 
efficiencies  can  be  obtained  if  one  first  generates  a  data  base  in  terms 
of  the  nominal  circuit  parameters  and  then  extracts  the  appropriate  symbolic 
transfer  function  from  the  data  base  each  time  a  different  symbolic  transfer 
is  required.  Of  course  the  benefit  to  be  achieved  via  such  an  approach  is 
dependent  on  the  size  of  the  data  base  and  the  ease  with  which  a  symbolic 
transfer  function  may  be  retrieved  therefrom. 
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The  obvious  manner  in  which  to  generate  such  a  data  base  is  to  simply 

pre-compute  the  coefficients  of  all  required  symbolic  transfer  functions 

and  store  them  in  the  data  base.  Retreival  from  such  a  data  base  is,  of 

course,  immediate  but  the  data  base  may  become  overly  large.  Indeed,  the 

number  of  transfer  functions  which  must  be  stored  is  0(k_^)  where  is  the 

total  number  of  potentially  variable  circuit  parameters  and  £  is  the  maximum 

number  of  circuit  parameters  which  may  vary  simultaneously.  An  alternative 

approach  is  to  store  the  nominal  transfer  function  information  and  then  use 

Householder's  formula  to  compute  the  required  symbolic  transfer  functions. 

In  such  a  data  base  we  need  only  store  0(£  )  transfer  functions  where  £  is 

the  total  number  of  component  output  terminals  but  retreival  requires 
3  3 

0(n  +p  )  multiplications  where  p  is  the  actual  number  of  circuit  parameters 
which  vary  simultaneously.  Since,  in  practice,  £  >>  p  the  retreival  process 
requires  approximately  O(n^)  multiplications  and  is  dominated  by  the  large 
dimensional  matrix  multiplication  required  by  Householder's  formula  rather 
than  the  low  dimensional  inverse. 

In  the  present  paper  we  will  formulate  an  alternative  data  base  for 

2 

the  symbolic  transfer  functions  which  also  requires  0(£  )  entries,  but  for 
which  retreival  requires  only  O(p^)  multiplications.  Since  p  is  typically 
small  this  is  tantamount  to  immediate  retreival. 
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A.  Sangiovanni-Vencentelli  and  R.  Saeks 


Multi  test  Diagnosibi 1 i ty  of  Nonlinear  Circuits  and  Systems 
A.  Sangiovanni-Vencentelli  and  R.  Saeks 


Abstract 

During  the  past  decade  a  considerable  research  effort  has  been  devoted 
to  the  analog  fault  diagnosis  problem  wherein  one  desires  to  locate  faulty 
circuit  components  given  the  overall  circuit  response  to  one  or  more  test 
vectors.  Conceptually  the  process  may  be  described  by  a  nonlinear 
equation 

y  ~  f(a,u) 

where  y  represents  the  measured  response  to  the  test  vector  u  given  the 
faulty  parameter  vector,  .  Since  us  is  know  and  y  is  a  measureable 
quantity  the  fault  diagnosis  problem  may  be  resolved  by  simply  solving  the 
above  equation  for  a  given  u  and  y.  Unfortunately,  in  practice,  the 
dimension  of  y  is  limited  by  the  number  of  accessible  test  points  in  the 
circuit  and  is  typically  smaller  than  the  dimension  of  the  parameter  vector 
thereby  precluding  direct  solution  of  the  above  equation.  To  alleviate 
this  difficulty  a  set  of  test  vectors;  {u-i^,  ...  »un}'»  is  employed 
yielding  the  set  of  simultaneous  equations 

yi  =  f(a,ui)  ;  i=l  ,2,  ...  ,m 

Since  the  parameter  vector,  a,  is  independent  of  the  choice  of  test  vector 
this  process  effectively  increases  the  number  of  available  equations 
without  increasing  the  number  of  unknowns.  More  concisely,  if  we  let 
£  =  colCy^ )  and  F  (a)  =  col  f(  ,u.)  the  "multi-test  vector"  fault  diagnosis 
problem  reduces  to  the  solution  of 

£  =  F  (a) 
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Needless  to  say  once  this  equation  has  been  formulated  its  solution 
is  amenable  to  standard  algorithms.  The  problem,  however,  is  to  determine 
whether  or  not  there  exists  a  set  of  test  vectors  {u,,u0,  ...  ,u  >  such  that 
equation  is  solvable  in  an  appropriate  sense.  To  this  end  we  will  formulate 
a  diagnosibility  criterion  directly  in  terms  of  the  function  f  which  determines 
the  degree  to  which  the  equation  =  F(a)  will  be  solvable  given  an  "optimal" 
choice  of  the  test  vectors.  Since  this  criterion  is  a  property  of  the 
circuit  rather  than  the  test  algorithm  it  can  therefore  be  used  as  a  design 
aid  with  which  to  choose  test  points  and/or  to  aid  in  designing  "testable 
circuits" . 
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Texas  Tech  University 

Joint  Services  Electronics  Program 


Institute  for  Electronic  Science 


Research  Unit:  4 

1.  Title  of  Investigation:  Multidimensional  System  Theory 

2.  Senior  Investigator:  John  J.  Murray  Telephone:  (806)  742-3506 

3.  JSEP  ,unds:  Current  $24,650 _ 

4.  Other  Funds: 

5 .  Total  Number  of  Professionals:  Pi's  1  (1  mo . )  RA 1 s  1  (1/2  time) 

6.  Summary: 

The  objective  of  the  work  unit  is  the  formulation  and  exploitation  of  a 
one  dimensional  scanning  model  for  the  digital  image  processing  problem.  For 
a  system  with  an  n-point  raster  width  the  resultant  model  is  periodically 
time-varying  and  is  characterized  by  an  n-by-n  matrix  of  rational  functions  in 
one  variable  rather  than  the  classical  two  variable  image  processing  model. 

The  scanning  model  includes  edge  effects  and  distortion  phenomena  inherent  in 
the  physical  scanning  process.  Moreover,  it  is  amenable  to  the  standard 
analytic  design  techniques  which  have  been  developed  for  multivariate  systems. 
The  major  difficulty  to  be  overcome  in  the  approach  is  that  one  must  work 
with  large  matrices  (n  is  typically  a  power  of  two  between  64  and  1024). 
Fortunately,  these  matrices  are  also  quite  degenerate  and,  as  such,  our  main 
effort  has  been  directed  at  the  development  of  techniques  for  working  with 
these  large  but  degenerate  matrices.  If  the  matrix  is  degenerate  is  its  in¬ 
verse  also  degenerate?  its  spectral  factors?  etc.? 

7.  Publications  and  Activities 

A.  Refereed  Journal  Articles 

1.  Murray,  J.,  "Some  Comments  on  Lumped-Distributed  Networks  and 
Differential-Delay  Systems",  in  Applications  of  Algebra  and 
Algebraic  Geometry  to  Linear  System  Theory,  Providence,  AMS, 

(to  appear) . 
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B.  Conference  Papers  and  Abstracts 

1.  Murray,  J.,  "A  Design  Method  for  2-D  Recursive  Digital  Filters", 
Proc.  of  the  13th  Asilomar  Conf.  on  Circuits,  Systems,  and 
Computers,  Pacific  Grove,  CA.,  Nov.  1979,  pp.  104-107. 

2.  Murray,  J.,  "A  New  Approach  to  2-D  Digital  Filtering",  Proc.  of 
the  24th  Midwest  Symp.  on  Circuits  and  Systems,  Univ.  of  New 
Mexico,  Albuquerque,  (to  appear). 

C.  Preprints 

1.  Murray,  J.,  "A  Design  Method  for  Two-Dimensional  Recursive  Digital 
Filters",  submitted  for  publication. 

D.  Theses 

1.  Chen,  S-H,  M.S.  Thesis  (in  preparation) . 

E.  Conferences  and  Symposia 

1.  Murray,  J.,  13th  Asilomar  Conf.  on  Circuits,  Systems,  and  Computers, 
Pacific  Grove,  CA.,  Nov.  1979. 

2.  Murray,  J.,  Workshop  on  Multidimensional  System  Theory,  Berkeley, 
CA.,  Nov.  1979. 
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A  DESIGN  METHOD  FOR  2-D  RECURSIVE  DIGITAL  FILTERS 


Proceedings  of  the  13th  Asilomar  Conference 
on  Circuits,  Systems,  and  Computers 


Pacific  Grove,  CA ,,  pp,  104-107,  Nov.  1979 


A  DESIGN  METHOD  FOR  2-D  RECURSIVE  DIGITAL  FILTERS 


John  Murray 

Electrical  Engineering  Department 
Texas  Tech  University 
LubbocJc,  Texas  79409 


Abstract 


A  method  is  described  for  the  design  of  two-dimensional  half-plane  recursive 
digital  filters,  in  the  form  of  a  cascade  connection  of  filters  which  are 
of  second  order  in  the  (principal)  direction  of  recursion,  and  of  arbitrar¬ 
ily  high  order  in  the  other  direction.  The  filters  thus  derived  are  shown 
to  be  automatically  stable,  but  yield  poor  responses  in  the  vicinity  of 
very  wide  or  very  narrow  bandwidths.  Some  techniques  for  tackling  these 
difficulties  are  discussed,  and  the  results  of  applying  these  design  proced¬ 
ures  are  shown. 


2.  INTRODUCTION 

Although  several  excellent  design  procedures 
for  two-dimensional  recursive  digital  filters 
are  known,  the  experience  of  classical  one- 
dimensional  filtering  (both  digital  and  ana¬ 
log)  strongly  suggests  that  no  one  technique 
is  best  for  all  problems  likely  to  be  encount¬ 
ered.  In  particular,  it  appears  that  a  design 
procedure  which  sacrifices  accuracy  or  imple¬ 
mentation  efficiency  to  simplicity  of  design 
would  be  of  value.  This  is  especially  the 
case  in  some  image  processing  applications, 
where  the  classical  design  objectives  of  low 
ripple,  narrow  transition  bands,  etc.,  can  be 
sacrificed  to  some  extent  without  significant 
loss  of  performance.  In  a  continuation  of 
some  previous  wdrk  [1],  such  a  procedure  is 
presented  here.  We  will  assume  that  the 
filter  specification  is  given  in  the  form  of 
a  frequency  response  to  be  approximated  on  the 
square  [-» , » ]x[-» , w  ] ,  and  that  this  response 
has  quadrantal  symmetry.  The  design  will  be 
in  the  form  of  a  cascade  of  recursive,  sym¬ 


metric  half-plane  filters. 

2.  SYMMETRIC  HALF-PLANE  FILTERS 
Although  the  idea  of  a  nonrecursive  symmetric 
half-plane  filter  has  been  known  for  a  con¬ 
siderable  length  of  time  [2],  and  has  recent¬ 
ly  been  used  as  the  basis  for  a  very  success¬ 
ful  design ' algorithm  [3j,  we  will  confine  our¬ 
selves  here  to  recursively  implementable  sym¬ 
metric  half-plane  filters.  The  most  general 
such  filter  has  a  denominator  of  the  form 


A(Z1,22) 


1  + 


m=l  n=-N 


_it^_  n 
3  Z  .Z. 
mn  1  2 


The  price  paid  for  restricting  the  denominator 
in  this  way  is  that  one  can  not  approximate  an 
arbitrary  magnitude  specification  using  such 
denominators  alone;  one  must  also  use  a  one- 
dimensional  "compensating"  filter  in  the  Z2~ 
direction. 

We  further  restrict  our  denominators  by  re¬ 
quiring  that  they  be  products  of  second-order 
factors  in  Z^;  thus  our  "elementary"  filters 
are  of  the  form 


H(Z1,Z2) 


1 


(1) 


unfortunately,  however,  it  is  transcendental 


l+p(92) Zx  +  q(92) Zx 
j32 

where  Z2  =  e  ,  and  p(9)  and  q(9)are  trigon¬ 
ometric  polynomials  of  order  N  and  have  real 
coefficients  (because  of  the  assumption  of 
quadrantal  symmetry) . 

For  recursive  symmetric  half-plane  filters, 
the  stability  conditions  are  given  by 

A<Z1(Z2)  ft  0  for  |Z1|<|,|Z2|  =  1. 

In  the  second-order  case  this  is  equivalent 
to  (in  the  notation  in  (1)) 

|p<02)  |  <  1  +  q'  .  <2,  ■  V  02 .  (2) 

This  is  the  stability  condition  with  which 
we  will  work. 

3.  THE  DESIGN  PROCEDURE 
We  assume  that  a  frequency  specification 
h(9^,92)  is  given;  we  want  to  design  a  stable 
filter  whose  denominator  is  a  product  of 
factors  of  the  form  (1) .  (We  will  actually 
take  the  numerators  to  be  of  this  form  also). 
We  proceed  as  follows: 

a)  For  each  value  of  92,  we  get  a  one¬ 
dimensional  frequency  specification  in  9^: 


as  a  function  of  Z2-  Thus  the  final  step  in 
the  design  procedure  is  the  following: 

d)  Approximate  r(02)  and  s(92)  by  trigono¬ 
metric  polynomials,  and  approximate  p(92)  and 
q ( 0 2 )  trigonometric  polynomials  in  such  a 

way  that  the  inequalities  (2)  continue  to 
hold.  (Since  the  one-dimensional  filters  de¬ 
signed  in  step  b)  are  stable,  the  transcen¬ 
dental  functions  p02)and  q(e2)  obtained  in 
step  b)  satisfy  the  inequalities  (2)  automat¬ 
ically)  . 

Approximating  r  ( 9 2 )  and  s ( G 2 )  is  easy,  since 
in  these  cases  the  approximation  is  uncon¬ 
strained.  In  order  to  approximate  pOj)  and 
q O 2 )  while  preserving  stability,  we  proceed 
as  follows: 

Pick  any  trigonometric  polynomial  P(9)  of 
order  N  with  the  following  properties: 

""  ..  i)  PO)  2,  Q  ,  Va 

ii)  P(9)d9  -  1 

-* 

iii)  P ( 9 )  is  a  good  approximation  to  5  0) 
(Dirac  Delta)  . 

Then  the  functions 


ha^(91)  =  h(9r  92) 

b)  For  each  value  of  02,  we  use  any  of 
the  design  procedures  available  in  one  dimen¬ 
sion  to  design  a  stable,  one-dimensional  re¬ 
cursive  filter,  in  the  form  of  a  cascade  of 
second-order  sections,  to  approximate  the 
specification  h„  (9.).  A  single  section 
would  look  like: 


1  +  r(9,)Z.  +  s(9,)Z? 

HU.,9,)  -  k(9,) - i - i — i- 

1  +  p(9j)Z1  *  q(92)2^ 

c)  If  we  now  ignore  the  factor  k ( 9 2 ) 

(which  goes  to  form  the  one-dimensional  com¬ 
pensating  filter) ,  what  we  have  is  a  two- 
dimensional  symmetric  half-plane  filter; 
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0(0)  = 

1  ^ 

57/  P(0-*)pU> 

d« 

and 

—  TT 

q(9)  = 

1  * 

J -/  P<e-*)q (») 

d$ 

-if 


can  be  seen  to  satisfy  the  inequalities  (2) 

(by  using  the  properties  i)  and  ii)  above, 
and  the  fact  that  p(9)  and  q(9)  satisfy  (2)). 
Further,  p(g)  and  q(0)  are  trigonometric  poly¬ 
nomials  of  order  N ,  since  P(9)  is,  and  by 
property  iii),  p ( 9)  and  q(9)  should  be  good 
approximations  to  p(9)  and  q (9) ,  respectively . 
In  more  familiar  terms,  this  procedure  con¬ 
sists  of  truncating  the  Fourier  series  for 
p(9)  and  q(9)  and  windowing  with  the  Fourier 
coefficients  of  P(9).  The  simplest  choice  of 


window  function  whose  Fourier  transform  satis¬ 
fies  i)  ,  ii)  and  in)  is  probably  the  triangu¬ 
lar  window,  whose  coefficients  are  given  by 


second-order  Butterworth  filter  in  detail. 


(Hicher-order  sections  are  virtually  identi¬ 
cal;  only  a  single  constant  needs  to  be 


n  >  N. 


In  this  case  P(e)  is  the  Fejer  kernel. 

When  the  weighting  and  windowing  procedure 
was  applied  in  practice  (with  a  triangular 
window)  the  amplitude  response  of  the  result¬ 
ing  filters  was  found  to  deviate  enormously 
from  the  desired  response  at  points  where  the 
bandwidth  was  close  to  0  or  close  to  n  .  This 
deviation  took  the  form  of  immensely  under¬ 
damped  response.  Further  analysis  showed  that 
this  could  be  cured  by  a  variation  of  the  a- 
bove  procedure.  This  consisted  of  applying 


changed . ) 

Our  ideal  response  is  given  by 


h<e1(e2) 


For  each  fixed  e^,  this  gives  a  one-dimension¬ 
al  lowpass  filter  in  @^,  with  cutoff  frequency 
equal  to  je^J.  The  bilinear  transform  of  a 
second-order  lowpass  Butterworth  filter  is 

Wc(1+V2 


W2+/2W  +1+2  (W2-l)  Z,  +  (W2-/2W  +1)2? 

C  C  C  1  c  c  1 

and  in  order  to  make  the  cutoff  frequency  of 

this  filter  equal  to  6,,  the  usual  frequency 


the  truncation  and  windowing  procedure  to  the  warping  relationship  indicates  that  we  must 


functions 


tan  y 2 | 


and  /I  +  q  -  p 

to  obtain  two  trigonometric  polynomials  a  and 


The  functions  p(0)  and  q(9)  are  then  calculat¬ 
ed  from 

p(0)  =  i(a2  +  62)  -1 

and  q(3|  ■  i(a2  -  a2). 

It  is  easy  to  see  that  the  p  and  q  given  by 
this  procedure  are  again  stable,  and  as  shown 
in  the  next  section,  they  yield  quite  satis¬ 
factory  responses.  However,  this  procedure 
does  have  the  disadvantage  of  doubling  the 
order  of  the  filter  in  Z2- 

4 .  EXAMPLES 

In  order  to  make  the  above  more  concrete,  an 


Now  (3)  can  be  written  in  the  form 


1+r  (G2)  Zj  +  sOj)  Z* 
l+p(02> Z1+q(02) Z2 


k(e2>  = 


w  +/2w  +1 

c  c 


r(02)  =  2 


q(02)  = 


2(W‘-1) 

w2+/Iw  +1 

C  C 


vr-/7w  +i 

c  c 


w;+/iw  +i 

c  c 


and  is  given  by  (4)  in  all  of  the  above 


example  consisting  of  a  90°  fan  filter  will  be  formulas. 

presented.  For  simplicity,  we  will  design  our  Thus’  in  order  to  desi9n  a  £ilter  which  is  of 


one-dimensional  filters  in  Z  ^  as  Butterworth 
** Iters,  and  will  develop  only  the  case  of  a 


order  2  in  Z^  and  order  N  in  Z2,  it  is  neces¬ 
sary  only  to  find  the  first  N  Fourier 


/ 


w 

» 


coefficients  of  each  of  the  functions 
2W_ 


/T+q+p 


and 


'I+q-P 


/w2  +  /2W  +  1 
c  c 


/*2+/Iw  +1 

c  c 


and  to  window  these  coefficients  with  a  tri¬ 
angular  window.  The  polynomials  p(9)  and 
q(0)  may  then  be  easily  calculated  by  use  of 
the  formulas  in  section  3.  The  one-dimension¬ 
al  compensating  filter  can  be  designed  using 
any  standard  one-dimensional  design  procedure. 
The  amplitude  response  of  a  second-order  fil¬ 
ter  with  N=8  is  shown  in  Fig.  1,  and  that  of 
an  eighth-order  filter  with  N=20  is  shown  in 
Fig.  2.  In  each  of  these  filters,  the  one¬ 
dimensional  compensating  filter  is  a  FIR  fil¬ 
ter  of  order  N. 

S.  CONCLUSIONS 

A  quick,  simple  method  for  designing  a  class 
of  two-dimensional  recursive  digital  filters 
has  been  presented.  Although  the  designs 
achieved  using  this  method  are  not  optimal, 
they  are  guaranteed  to  be  stable  (apart  from 
possible  numerical  error) ,  and  can  yield 
respectable  results  for  sufficiently  high 
orders.  The  computation  time  required  is 
somewhat  greater  than  that  required  for  the 
calculation  of  (M+l) (N+l)  Fourier  coefficients, 
where  M  is  the  order  of  the  filter  in  Z^,  and 
N  is  the  order  in  Z^. 
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Abstract  of 

A  NEW  APPROACH  TO  2-D  DIGITAL  FILTERING 


John  Murray 


Abstract 


A  new  approach  to  two-dimensional  digital  filtering  is  presented.  It 
is  based  on  a  periodically  time-varying  model  which  accurately  r°flects 
the  scanning  process  inherent  in  most  recursive  multidimensional  signal 
processing.  Such  models  are  essentially  equivalent  to  multi-input,  multi¬ 
output,  one-dimensional  time-invariant  systems,  and  therefore  permit  the 
application  of  classical  techniques  to  design  and  analysis  problems.  Two 
further  advantages  of  this  approach  are  its  flexibility  and  the  fact  that 
it  by-passes  the  problem  of  boundary  conditions. 
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Abstract  of 


A  DESIGN  METHOD  FOR  2-D  RECURSIVE  DIGITAL  FILTERS 


John  Murray 


i 


Abstract 

A  method  is  described  for  the  design  of  two-dimensional  half-plane 
recursive  digital  filters,  in  the  form  of  a  cascade  connection  of  filters 
which  are  of  second  order  in  the  (principal)  direction  of  recursion,  and 
of  arbitrarily  high  order  in  the  other  direction.  The  filters  thus  derived 
are  shown  to  be  automatically  stable,  but  yield  poor  responses  in  the 
vicinity  of  very  wide  or  very  narrow  bandwidths.  Some  techniques  for 
tackling  these  difficulties  are  discussed,  and  the  results  of  applying 
these  design  procedures  are  shown. 


Abstract  of 

A  DESIGN  METHOD  FOR  TWO-DIMENSIONAL 
RECURSIVE  DIGITAL  FILTERS 


0.  Murray 


Abstract 


A  method  for  designing  two-dimensional,  symmetric  half-plane  recursive 
digital  filters  is  presented:  a  filter  is  first  designed  as  a  parameterized 
family  of  one-dimensional  filters;  a  simple  approximation  is  then  used  to 
find  a  rational,  stable  two-dimensional  filter.  Some  advantages  and 
disadvantages  of  the  method  are  discussed,  and  several  examples  are  given. 
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Abstract  of 

SOME  COMMENTS  ON  LUMPED-DISTRIBUTED  NETWORKS 
AND  DIFFERENTIAL-DELAY  SYSTEMS 


J.  Murray 


Abstract 


An  analytic  approach  to  the  similarities  and  differences  between 
lumped-distributed  networks  and  differential -del ay  systems  is  presented. 

This  approach  is  based  on  the  calculation  of  the  spectrum  of  a  commutative 
Banach  Algebra  of  appropriate  convolution  operators;  it  is  shown  that  this 
calculation  naturally  involves  the  two  complex  variables  approach  of 
lumped-distributed  circuit  theory,  and  thus  gives  a  link  between  this  and 
the  convolution  approach.  Further,  when  this  spectrum  is  drawn,  it  gives 
some  intuition  for  the  systems  in  question;  for  example,  it  becomes  clear 
that  the  passive  synthesis  problem  is  two-dimensional,  while  the  stability 
problem  is  one-dimensional,  unless  delays  of  arbitrary  length  are  considered. 
It  also  shows  that  the  analog  of  the  Nyquist  criterion  in  this  situation 
involves  two  "winding  numbers". 
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ABSTRACT  OF 


SOME  EFFECTS  OF  SIGNAL-DEPENDENT  NOISE  ON  ESTIMATOR  STRUCTURES 


Gary  K.  Froehlich,  John  F.  Walkup  and  Thomas  F.  Krile 


Abstract 

Optimal  estimators  are  derived  for  a  very  general  measurement  model 
which  can  be  made  to  include  (or  exclude)  a  signal -dependent  noise  term. 

The  estimators  include  minimum  mean-square  error  (MMSE),  maximum 
a  pobteAsLoni  (MAP),  and  maximum  likelihood  (ML)  estimators.  Then,  for  the 
specific  case  of  photographic  film-grain  noise,  the  sensitivity  of  the 
estimators'  structures  to  the  strength  of  the  signal -dependent  noise  term 
is  described.  In  addition,  the  performance  of  each  estimator  is  found  by 
simulation,  and  compared  with  the  performance  under  various  mismatched 
conditions  wherein  certain  a  psUoxi  assumptions  about  the  signal  statistics 
are  violated. 
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ABSTRACT  OF 

ESTIMATION  IN  SIGNAL-DEPENDENT  FILM-GRAIN  NOISE 


G.  Froehlich,  J.  Walkup  and  T.  Krile 


Abstract 


Optimal  estimators  are  derived  for  a  signal -dependent  film  grain  noise 
model,  and  the  effect  of  signal-dependence  on  the  estimators'  structures 
is  investigated.  Due  to  the  mathematical  complexity  of  these  optimal 
estimators,  various  suboptimal  estimators  are  proposed.  Computer  simulations 
are  then  presented  which  compare  the  optimal  and  suboptimal  estimators  with 
regard  to  mean-square  estimation  error,  sensitivity  to  signal-dependence, 
and  robustness  (with  respect  to  the  a.  pulofu.  probability  density  of  signal). 
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G.  Froehlich,  J.  Walkup,  and  T.  Krile 


Abstract 


A  general  model  incorporating  signal-dependence  noise  is  introauced. 
Joint  maximum  a  poiteAloxi  (MAP)  and  joint  maximum  likelihood  (ML)  estimators 
are  derived,  followed  by  a  discussion  of  the  effects  of  statistical  coupling 
between  adjacent  measurements  and  nonstationarity  on  the  part  of  the  signal. 
An  alternate  approach,  using  state-space  methods,  is  also  discussed. 
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requires  that  we  distinguish  between  the  various  objects  and  simultaneously 
track  the  motion  of  a  prescribed  object. 
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space.  Rather,  we  choose  to  model  the  motion  of  the  image  by  a  Lie  group 
(of  tr .islations,  rotations,  magnifications)  which  results  in  a  greatly 
simplified  equation  of  motion. 
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ABSTRACT 

Consider  a  2-dimensional  image  in  which  objects  are  in  motion 
through  trajectories  describable  by  translation  (both  horizontal  and 
vertical),  rotation,  and  magnification.  The  trajectory  of  such  an  object 
can  be  completely  described  by  a  4-vector  of  parameters  X(t)=3(X^,X2»^3,^4) 
which  determine  the  velocities  with  respect  to  the  four  possible  motions. 
If  the  data  at  time  t  and  position  x  in  the  view  plane  is  written  as 
F(t,x),  then  we  can  show  that 

|f  -  £  V<>XtF, 

where  X^,  X2,  X3  and  X4  are  certain  (known)  differential  operators  asso¬ 
ciated  with  the  group  of  motions. 

The  derivatives  appearing  above  may  be  evaluated  numerically  at 
various  points  in  a  given  time  slice  to  produce  a  system  of  linear 
equations  which  may  be  solved  for  the  motion  parameters.  Evaluation 
at  points  within  a  moving  rigid  body  leads  to  a  vector  of  notion  param¬ 
eters  unique  to  that  particular  body.  In  principle,  at  least,  this 
technique  permits  application  to  tracking  as  well  as  segmentation  of 
images  based  on  relative  motion  of  various  objects. 

The  paper  concludes  by  presenting  the  results  of  having  implemented 
the  above  method  on  digitized  video  images. 


INTRODUCTION 

A  complex  three  dimensional  scene  may  contain  an  arbitrary  number 
of  objects,  each  of  which  is  in  motion  relative  to  a  stationary  background. 
The  trajectories  of  the  various  objects  may  or  may  not  be  the  same.  When 
such  a  scene  is  projected  on  a  viewing  plane  (for  example,  through  the  use 
of  a  television  camera),  the  various  objects  appear  as  moving  regions  which 
vary  in  time  in  a  complex  fashion  as  a  result  of  their  actual  trajectories 


in  space.  Variations  due  to  certain  trajectories,  such  as  rotation  about 
a  line  parallel  to  the  image  plane,  are  not  readily  predictable.  Pre¬ 
viously  unseen  patches  of  the  surface  of  an  object,  may  be  brougnt  into 
view  for  the  first  time,  while  others  may  disappear.  In  addition,  a 
near  object  may  pass  between  the  camera  and  a  distant  object,  occluding 
all  or  part  of  the  latter. 

The  situation  is  further  complicated  in  case  mobility  is  provided 
at  the  camera.  Motion  of  the  camera  results  in  an  opposing  change  in 
the  apparent  notion  of  all  of  the  objects  in  the  scene,  including  back¬ 
ground.  In  many  applications  camera  mobility  is  desirable  or  even 
necessary.  For  instance,  in  tracking  applications  the  motion  of  the 
camera  is  required  to  stabilize  a  particular  portion  of  the  scene  within 
the  viewing  field.  Although  this  may  in  general  be  impossible,  as  with 
the  rotating  objects  mentioned  above,  a  fair  degree  of  stabilization 
with  respect  to  position,  size,  and  orientation  car.  be  achieved. 

In  the  following  sections  we  present  a  model  for  describing  motion 
in  images  which  is  valid  in  a  large  number  of  practical  applications  and 
which  is  a  reasonable  approximation  in  many  others.  A  novel  feature  is 
that  camera  motion  and  relative  motion  of  objects  within  a  scene  are 
both  described  within  the  model. 


THEORETICAL  MODEL 


Let  G  be  a  Lie  group  of  transformations  on  an  analytic  manifold  M. 
Suppose  G  has  dimension  n  while  M  has  dimension  m.  Let  x  and  y  denote 
the  coordinates  of  elements  f  and  g  in  G,  respectively,  in  a  patch  con¬ 
taining  the  identity  element  e  of  G.  Also,  let  p  denote  coordinates  of 
an  element  u  of  M  in  some  patch  in  M.  We  may  then  express  the  coordinates 
z  of  the  product  h  *  fg  and  the  coordinates  q  of  the  element  v  =  gu, 
relative  to  suitable  patches,  by  means  of  analytic  functions 

z  *  J(x,y)  (1) 


q  =*  K(y,p)  (2) 

K  and  J  are  vector-valued,  having  values  in  n-dimensional  space  Rn 
or  Cn  and  m-dimensional  space  Rm  or  Cm.  Hereafter  we  shall  assume  that 
these  underlying  spaces  are  real.  We  denote  the  ith  component  of  J  by 
and  the  jth  component  of  K  by  Kj . 

In  order  to  define  the  Lie  algebra  of  G  we  first  introduce  real¬ 
valued  maps  on  G  by 


(x) 


aj 

3T7(x’y) W 

J 


(3) 
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where  i  and  J  each  range  from  1  to  n.  The  cross-section  whicn  con¬ 

sists  of  the  P^-i  as  i  ranges  from  1  to  n,  and  j  is  fixed,  may  be  thought 
of  as  a  vector  rield  in  Rn.  Such  a  vector  field  attaches  to  a  point  x 
the  vector  P* j (x) .  As  such,  P*^,P*2» • • • ,?*n  form  a  basis  for  the  tangent 
space  at  the  point  x  [1,2].  In  view  of  the  correspondence  between  elements 
f  in  G  and  the  coordinates  in  Rn,  the  tangent  vectors  are  implicitly 
attached  to  the  elements  of  G. 

In  terras  of  the  above  vector  fields  we  may  express  the  infinitesimal 
transformations  of  G  by  defining,  for  each  j  =  l,2,...,n, 

h  '  <4) 

The  differencial  operators  so  defined  are  to  be  considered  as  linear 
operators  on  the  space  of  analytic  functions  on  G,  or,  more  generally,  on 
the  space  of  differentiable  functions  on  G.  The  lie  algebra  of  G  is  simply 
the  n-dimensional  vector  space  consisting  of  all  linear  combinations  of 
these  operators,  and  will  be  denoted  by  L(G)  [2], 

Now  it  is  a  surprising  and  useful  fact  that  the  Lie  algebra  of  G 
may  be  defined  in  terms  of  its  actions  on  the  manifold  M.  Analogous  to 
(3)  we  define 

3K 

'V?)  =  3^(y’p)iy=e  (5) 

for  a  =  l,2,...,m  and  j  *  l,2,...,n.  Finally,  as  in  (4)  above  we  set 

X!  =  l  Q,.  ~  .  (6) 

J  0.1  c U*  «Pa 

The  operators  X],...,X^  span  a  Lie  algebra  L'(G)  which  is  also  of  dimension 
n.  Note  that  these  operators  act  on  functions  defined  on  the  manifold  M. 

Many  interesting  relationships  may  be  shown  to  hold  between  the  two 
representations  of  the  Lie  algebra  of  G  as  given  abeve.  However,  the 
following  property  is  of  immediate  interest  to  our  application: 

Theorem  1:  Let  f:  M-*-R  be  differentiable  and  define  F:  G*M-*-R,  in  terms 
of  coordinates  by 

F(x,p)  -  f (K(x,p) ) .  (7) 

Then  for  each  j  ■  1,2 . .  vs  have 


XjF  -  X'F. 


» 
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Proof:  First  we  shall  show  that  for  each  j  =*  we  have 

XjK  -  Xj  K.  (9) 

We  note  that  from  the  action  of  G  on  M  we  obtain 

K(J(x,y),p)  =  K(x,K(y,p))  (10) 

for  all  x,y  and  p  in  suitable  coordinate  patches.  Application  of  the 
operator 


-5-1 

3yi‘j'=e 


to  both  sides  of  (10)  gives 


3KQ(J(x,y) ,p) 


'y=e 


n  3J,  (x,y) 

y  — - 1 

k-i 


3lCa(x,p) 
3xk  ~ 


n  3K  (x,p) 

7  P.  .  (x) — r -  =  X.K  (x,p) 

L  kj  3x^  j  a  ’ r 


k=l 


for  the  left  hand  side  and 


3Ka(x,K(y,p)) 

3y^ 


'y=e 


m  3Kg(y,p) ^  3Ka(x,p) 

b=! 


ra  3K  (x,p) 

l  QSj(p)—p -  "  X!^(x,?) 


0s*  1 


0 


J  a 


on  the  right  hand  side.  From  this  it  follows  that  XjK  =  XjK  as  desired. 
Now  setting  q  =  K(x,p)  and  performing  a  computation  similar  to  that  above, 
we  find  that 


XjF(x,p) 


l  W*»P>  •  ^ 


a=l 


j  a 


a 


and  that 


X'F(x,p)  *  l  X'Ka(x,p)  •  . 

J  a=l  J  Ha 


The  result  of  the  theorem  follows  immediately  from  this  and  our  preliminary 
result. 
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terms 
in  Rn 
given 


Now  let  us  consider  a 
of  a  coordinate  patch 
satisfying  x(0)  *  0. 
as  the  solution  of  an 


curve  t-»-g(t)  in  G  satisfying  g(0)  =  e.  In 
at  a,  g(t)  may  be  described  by  a  curve  x(t) 
We  shall  consider  the  case  in  which  x(t)  is 
evolution  equation  of  the  form 


x(t)  = 


n 

I 

1=1 


Xi(t)p#i(x(t)),  x(0) 


0, 


(11) 


where  P*j,...,P*n  ara  cross-sections  of  the  array  of  functions  given  by 
(3),  and  the  control  functions  X^(t) , . . . , X^  (t)  are  suitable  continuous 
functions.  The  latter  are  the  parameters  of  motion,  and  have  the  char¬ 
acteristics  associated  with  velocity,  thereby  providing  a  basis  for  the 
continuity  assumption. 

Now  let  p  denote  the  coordinates  of  a  point  u  in  some  coordinate 
patch.  For  a  differentiable  map  f:  M-+R  we  may  define  R:  Rx'M-*-R  by  setting 

H(t,p)  =  f(g(t)u) .  (12) 

We  recognize  chat  H(t,p)  =  F(x(t),p)  where  F  is  the  extension  of  f  to 
G*M  as  in  Theorem  1  above.  From  the  point  of  view  of  application,  if  we 
regard  f:  M-+-R  as  an  image,  then  H(t,p)  represents  the  moving  image  obtained 
by  translation  due  to  the  curve  g(t).  We  may  now  present  our  main  result. 


Theorem  2:  In  the  context  described  above  we  have 


3H 

9t 


l  X  (t)X!H. 
i-1 


Proof:  We  have 


3H  ,  3F(x(t) ,p) 

yc(t,P)  3^-^- 


^(t)^r(x<t),p)  = 

1  3  j 


l  (  Z  ^i(OP n(x(t)))~(x(t),p)  = 

j=*l  i=l  3  j 


(13) 
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By  Theorem  1  we  have  X^F  c  X^T.  But  clearly  X^7(x(t)fp)  =*  X|H(t,p),  so  that 

g^-(t,p)  *  l  Xi(t)X^H(t,p) , 

i=l 

as  desired. 

We  should  observe  that  the  results  above  are  presented  as  local 
properties  which  hold  in  suitable  neighborhoods  and  appear  to  be  highly 
coordinate  dependent.  As  a  matter  of  fact,  though  we  shall  not  attempt 
to  prove  it  here,  the  underlying  vector  fields  continue  globally  through¬ 
out  both  G  and  M  to  give  corresponding  global  analogues  of  these  theorems. 

The  primary  importance  of  Equation  (13)  lies  in  the  fact  that  it 
gives  a  linear  equation  in  the  control  parameters  X^,...,Xn  with  coeffi¬ 
cients  that  are  in  principle  observable,  since  the  values  n(t,p)  constitute 
the  data. 

In  the  next  section  this  result  will  be  applied  to  the  problem  of 
tracking  spatial  objects  through  the  use  of  two-dimensional  projections. 


APPLICATIONS  TO  VIDEO  TRACKING 

The  control  system  for  the  Real-Time  Videotheodolite  (RTV)  permits 
four  basic  motions  of  the  camera  [3].  These  are  azimuth,  elevation, 
electronic  rotation  of  the  view  plane,  and  lens  zoom.  Whan  the  effects 
of  these  motions  on  the  viewing  plane  are  scrutinized,  we  see  that  they 
correspond,  respectively,  to  horizontal  translation,  vertical  translation, 
rotation,  and  magnification  -  at  least  to  a  satisfactory  degree  of  approx¬ 
imation.  Moreover,  inspection  of  a  number  of  real  images  reveals  that  a 
surprisingly  large  number  (but  not  all)  motions  of  spatial  objects,  when 
projected  on  the  viewing  plane,  are  likewise  well  approximated  by  these 
four  motions  in  the  plane. 

Thus  with  only  a  mild  apology  we  restrict  our  attention  in  what 
follows  to  the  group  G  generated  by  horizontal  and  vertical  translations, 
rotation,  and  magnification.  The  corresponding  generators  for  the  Lie 
algebra  of  G  are  as  follows: 


X1 

M 

(14a) 

X2 

3 

3y 

(14b) 

X3 

u 

1 

3 

(14c) 

X4 

3 

*57 

(14d) 
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In  these  equations  we  are  using  x  and  y  as  coordinates  in  the  view  plane 
M  *=  R*R  and  have  represented  the  infinitesimal  transformations  as  they 
act  on  M. 


Let  us  note  that  in  the  theorems  of  the  previous  section  it  was 
assumed  that  the  trajectories  of  all  of  the  points  of  M  were  derived 
from  the  same  evolution  equations.  However,  for  complex  scenes  we  find 
that  various  objects  may  be  present  which  have  different  trajectories. 

A  little  reflection  reveals,  nevertheless,  that  the  conclusions  of  Theorem 
2  remains  valid  as  long  as  we  avoid  the  boundaries  between  objects  or 
regions  having  different  trajectories.  In  the  present  context,  we  may 
paraphrase  the  results  of  Theorem  2  as  follows: 

Theorem  3:  Let  H(t,x,y)  be  a  time  varying  two  dimensional  image.  Within 
the  interior  of  each  object  in  the  image  which  is  moving  along  a  G- 
trajectory,  we  have 


9H 

3t 


4 

1  Ut)XH, 

i=l 


(15) 


where  X^, . . . .X^  are  continuous  functions  and  are  given  in  (14). 

Upon  evaluation  of  the  various  derivatives  appearing  in  (15)  at 
each  point  of  a  suitable  grid,  within  a  given  time  slice,  we  obtain  a 
system  of  linear  equations  which  may  be  solved  for  the  parameters  of 
motion,  A^,...,^.  In  the  example  to  be  presented,  a  3  *  3  grid  was  used. 

A  sequence  of  digitized  video  images  showing  the  launch  of  a  Hawk 
missile  were  obtained  from  the  U.S.  Army  'White  Sands  Missile  Kange.  The. 
images  were  trimmed  to  128  *  128  pixels  from  full  frame  interlaced  video 
in  which  each  raster  line  was  sampled  512  times. 

One  of  the  frames  is  shown  in  the  upper  left  of  the  illustration 
below.  Of  noteworthy  interest,  we  mention  the  "cold  plume"  region  (lower 
left)  which  c.an  be  seen  billowing  out  behind  the  missile.  Although  hardly 
discernible,  the  foreground  contains  several  buildings  and  other  ground 
clutter . 


By  evaluation  of  Equation  (15)  at  each  point  of  a  3  *  3  neighborhood 
of  each  pixel.,  nine  equations  in  the  four  parameters  \ A4  were  obtained 
In  the  upper  right  frame  of  the  illustration,  we  see  the  results  of  scaling 
the  horizontal  translation  component,  A]_  for  display.  The  effect  of  image 
noise  and  truncation  error  is  apparent  from  the  rapid  transition  from 
white  to  black  in  this  view.  This  component  of  the  velocity  profile  was 
passed  through  a  median  filter  to  obtain  the  image  shown  in  the  lower 
left  of  the  illustration.  Finally,  in  the  lower  right  we  see  the  results 
of  thresholding,  about  A^  =  0.  In  this  image  the  dark  region  indicates 
points  which  are  at  rest  relative  to  the  camera  (which  was  apparently 
successfully  tracking  the  missile),  while  the  white  regions  appear  to  be 
moving  with  respect  to  the  camera. 


It  is  interesting  to  note  that  the  cold  region  of  the  plume  has 
been  correctly  classified  with  the  background,  while  the  hot  region  of 
the  plume  appears  to  be  moving  with  the  missile. 


Figure  1.  Processing  the  launch  of  a  'Hawk  missile. 

Similar  results  were  obtained  with  other  parameters  and  with  other 
images.  These  results  are  encouraging,  although  the  numerical  methods 
employed  are  clearly  too  susceptible  to  noise  and  truncation.  Better 
computational  procedures  are  being  explored,  including  one  technique 
which  is  based  on  integration  rather  than  differentiation. 


SUMMARY  AND  CONCLUSIONS 

We  have  developed  a  fundamental  equation  satisfied  by  moving  images 
which  uses  Lie  theory  to  determine  the  trajectories  of  various  objects 
within  an  image.  The  theory  has  been  implemented  on  real  data  with  some 
success.  While  the  implementation  suffers  from  the  effects  of  random 
noise  and  truncation  errors,  the  results  obtained  have  shown  sufficient 
success  as  to  be  encouraging.  We  feel  that  the  computations  can  be 
greatly  improved  by  the  incorporation  of  better  numerical  methods. 
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Abstract 


Motion  of  objects  in  time-varying  images  can  sometimes  be  described 
by  the  action  of  a  group  of  transformations  on  the  image  plane,  regarded 
as  a  manifold.  Moreover,  the  transformation  groups  occurring  in  applications 
can  generally  be  described  analytically  in  terms  of  a  finite  number  of 
parameters;  that  is  to  say,  they  are  Lie  groups.  In  this  situation  we 
show  that  that  data  satisfies  a  linear  part.al  differential  equation  in 
which  the  parameters  of  motion  appear  as  linear  coefficients.  More  or  less 
standard  numerical  methods  permit  these  parameters  to  be  determined. 

The  parameters  of  motion  determined  as  indicated  above  may  be  regarded 
as  a  velocity  profile.  This  profile  has  the  useful  property  of  being 
spatially  constant  for  each  moving  object  in  the  image.  In  principle, 
at  least,  this  permits  detection  and  tracking  of  various  objects  having 
different  trajectories. 

Following  development  of  the  appropriate  theory,  the  paper  concludes  by 
presenting  the  results  of  applying  the  technique  to  a  number  of  real  images 
in  the  form  of  digitized  video. 
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ABSTRACT  OF 

RESULTS  IN  DIFFERENTIAL  GEOMETRY  WITH  APPLICATION  TO  VIDEO  TRACKING 


G.A.  Fredricks  and  T.G.  Newman 


Abstract 


We  present  some  results  concerning  the  interplay  between  various 
vector  fields  arising  from  the  action  of  a  Lie  group  on  a  smooth  manifold. 
Although  the  proofs  are  elementary,  the  results  are  both  surprising  and 
applicable.  In  the  last  section  we  show  that  the  fundamental  partial 
differential  equation  in  the  main  theorem  is  at  the  mathematical  foundation 
of  video  tracking. 
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Abstract 


The  classical  canonical  forms  theorems  for  second  order  linear 
partial  differential  operators  and  equations  in  two  variables  are 
generalized  to  n  variables  for  nondegenerate  operators.  These  general¬ 
izations  are  geometric,  involving  the  Riemann  curvature  tensor  and  the 
conformal  curvature  tensor  of  Weyl  and  Schouten.  A  Sylvester  Theorem 
for  symmetric  matrices  with  smooth  entries  is  also  proved. 
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Texas  Tech  University  Institute  for  Electronic  Science 

Joint  Services  Electronics  Program  Research  Unit:  7 

1.  Title  of  Investigation:  Image  Processing  System 

2.  Senior  Investigator:  John  F.  Walkup  Telephone:  (806)  742-3500 

3.  JSEP  Funds:  Current  $33,025+ 

4.  Other  Funds:  Current  $10,000* 

it 

5.  Total  Number  of  Professionals:  None 

6.  Summary : 

The  purpose  of  the  work  unit  is  to  partially  fund  the  purchase  of  an 
image  processing  system  to  be  used  in  support  of  the  research  associated 
with  work  units  4,  5,  and  6.  Each  of  these  work  units  deals  with  an  aspect 
of  the  image  processing  problem  and  in  each  case  experimental  validation 
of  the  various  theoretical  investigations  is  required. 

i.  Budget:  Total  funding  for  the  purchase  of  the  image  processing 
system  will  be  approximately  $247,000  derived  over  the  three  year  contract 
using  capital  equipment  funds  derived  from  this  work  unit,  work  units  4,  5, 
and  6  together  with  College  of  Engineering  and  University  matching  funds. 

We  have  also  negotiated  an  agreement  with  the  university  for  financing  the 
system  with  the  equipment  being  ordered  at  the  beginning  of  the  contract 
period  but  billed  to  0NR  in  three  separate  federal  fiscal  years  as  required 
by  the  contract. 

*State  of  Texas  matching  funds  for  this  work  unit. 

U 

This  work  unit  represents  a  request  for  capital  equipment  funds.  Personnel 
using  the  equipment  will  be  supported  by  work  units  4,5,  and  6. 

+In  addition  to  this  supplemental,  capital  equipment  funds  from  regular  work 
units  4,5,  and  6  will  be  used  for  the  purchase  of  the  image  processing 
system  in  the  amount  of  $31,000  for  the  year. 
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ii.  Host  Computer:  We  have  recently  completed  the  purchasing  process 
for  the  host  computer  for  the  image  processing  system  and  submitted  a 
purchase  order  to  Digital  Equipment  Corp.  for  a  "Unibus  VAX".  This  is 
essentially  a  VAX  11/780  CPU  with  POP  11/70  peripherals.  As  such,  we 
obtain  the  power  and  expandability  of  the  VAX  CPU  at  a  price  close  to  that 
of  the  PDP  11/70.  The  VAX  CPU  will  have  all/4  MB  of  random  access  memory, 
two  28MB  disks,  and  a  1600  bpi  tape  drive. 

iii.  Image  Display/Array  Processor:  A  Comtal/3M  Vision  120  display 
system  has  been  ordered.  The  system  includes  memory  for  3  image  displays 
and  four  graphics  planes,  full  arithmetic  capability  and  a  high  level 
firmware  operating  system  as  well  as  interfaces  to  the  VAX  11/780. 

iv.  Delivery:  Both  the  computer  and  display  are  scheduled  for 
delivery  in  the  late  spring  or  early  summer  of  1981  and,  as  such,  we  expect 
to  have  the  system  up  and  operating  during  the  summer  of  1981. 

7.  Publications  and  Activities: 

A.  Conferences  and  Symposia 

1.  Saeks,  R.,  1980  ACM  Computer  Graphics  Conference  (SIGGRAPH/80) , 
Seattle,  July,  1980. 
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Texas  Tech  University  Institute  for  Electronic  Science 

Joint  Services  Electronics  Program  Research  Unit:  8 


1.  Title  of  Investigation:  Director's  Discretionary  Fund 

2.  Senior  Investigator:  R.  Saeks  Telephone:  (806)  742-3528 

3.  JSEP  Funds:  Current  $19,075 

4.  Other  Funds: 

5.  Total  Number  of  Professionals:  To  be  Determined 

6.  Summary: 

During  the  past  year  the  directors  discretionary  fund  has  been  used 
to  complete  work  on  a  large  scale  systems  work  unit  from  the  1978/79  JSEP 
program  (mainly  running  examples  of  the  theory  which  was  developed  previous 
ly  and  preparing  publications),  to  initiate  work  on  a  new  approach  to 
integrated  circuit  design,  and  to  begin  a  preliminary  investigation  of  the 
potential  for  parallel  processing  in  system  theory. 

7.  Publications  and  Activities: 

A.  Refereed  Journal  Articles 

1.  Karmokolias,  C.,  Portnoy,  W.,  and  R.  Saeks,  "Optimal  Selection 
of  IC  Fabrication  Parameters",  Inter.  Jour,  of  Circuit  Theory 
and  its  Applications  (to  appear). 

B.  Conference  Papers  and  Abstracts 

1.  Green,  B.,  Saeks,  R.,  and  K.S.  Chao,  "Continuation  Algorithms 
for  the  Eigenvalue  Problem",  Proc.  of  the  1980  IEEE  Inter. 

Symp.  on  Circuits  and  Systems,  Houston,  May  1980,  p.  775, 
(abstract  only). 

2.  Iyer,  A.,  and  R.  Saeks,  "Numerical  Implementation  of  a  Continua 
tion  Algorithm  for  the  Eigenvalue  Problem",  1980  IEEE  Inter. 
Conf.  on  Circuits  and  Computers,  Port  Chester,  Oct.  1980,  pp. 
437-440. 


175 


C.  Preprints 

1.  Green,  B.,  Saeks,  R.,  Chao,  K.S.,  and  A.  Iyer,  "Continuation 

Algorithms  for  the  Eigenvalue  Problem",  submitted  for  publication. 

D.  Theses 

1.  Iyer,  A.,  "Numerical  Implementation  of  a  Continuation  Algorithm 
for  the  Eigenvalue  Problem",  M.S.  Thesis,  Texas  Tech  Univ.,  1980. 

E.  Conferences  and  Symposia 

1.  Saeks,  R.,  1980  IEEE  Inter.  Symp.  on  Circuits  and  Systems, 

Houston,  May  1980. 

2.  Iyer,  A.,  and  R.  Saeks,  1980  IEEE  Inter.  Conf.  on  Circuits  and 
Computers,  Port  Chester,  Oct.  1980. 
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NUMERICAL  IMPLEMENTATION  OF  A  CONTINUATION 
ALGORITHM  FOR  THE  EIGENVALUE  PROBLEM 


A.  Iyer  and  R.  Saeks 
Department  of  Electrical  Engineering 
Texas  Tech  University 
Lubbock,  Texas  79409 


ABSTRACT :  An  algorithm  for  the  solution  of  the 
eigenvalue  problem  for  a  continuous  parameterized 
family  of  sparse  matrices  is  presented.  A  con¬ 
tinuous  LU  (or  LR)  algorithm  is  implemented  re¬ 
cursively.  The  sparsity  of  the  given  matrices  is 
preserved  throughout  the  numerical  process. 

I .  Introduction 

In  recent  years  a  number  of  stability  tests 
for  linear  systems  have  been  proposed  which  re¬ 
quire  the  evaluation  of  the  eigenvalues  of  a  con¬ 
tinuously  parameterized  family  of  sparse  matrices 
for  their  implementation.  Most  notably  of  these 
are  the  multivariate  Nyquist  test  of  MacFarlane, 
et  al.,7  the  application  of  the  multivariate 
Nyquist  test  in  an  interconnected  systems  con¬ 
text,3  and  a  '"root  locus  like"  formulation  for 
interconnected  systems. 3,‘*  Typically,  one  employs 
a  classical  eigenvalue  package  at  a  sequence  of 
parameter  values,  possibly  with  special  software 
to  exploit  the  common  sparsity  pattern  of  the 
various  matrices.  Alternatively,  one  can  compute 
the  eigenvalues  at  an  initial  parameter  value  and 
"continue  the  result"  by  integrating  an  appropri¬ 
ate  differential  equation  whose  trajectors  define 
the  eigenvalue  loci  of  the  given  family  of 
matrices.  The  most  common  such  differential 
equation5  for  a  continuously  parameterized  family 
of  matrices,  M( r ) ( =M) ,  takes  the  form 
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(1.2) 

(1.3) 


where  x^  is  the  ith  eigenvalue  of  M,  e,  is  the 
corresponding  eigenvector,  is  the  comples  con¬ 
jugate  of  Xj,  and  f<  is  the  eigenvector  of  the 
matrix  M*  associated  with  the  eigenvalue  Tv  of  N*. 
Here,  all  vectors  and  matrices  nat  be  complex, 

*  ,  >  denotes  the  complex  Inner  product, 
denotes  the  complex  conjugate/transpose,  and  the 
set  of  differential  equations  1.1  through  1.3  are 
well  defined  whenever  M  has  distinct  eigenvalues.5 


The  major  difficulty  with  the  above  described 
"continuation  algorithm"  is  that  the  array  of 
eigenvectors  for  a  sparse  matrix  is  typically  non- 


sparse.10  As  such,  the  computational  benefits  of 
working  with  the  sparse  matrix  M  will  be  lost  if 
one  attempts  to  integrate  equations  1.1  through 
1.3.  This  is  mostly  readily  illustrated  by  letting 

S  =  col(fj)  be  the  n  by  n  matrix  whose  rows  are 
defined  by  the  eigenvectors  of  M*.  Then,  assuming 
that  the  eigenvectors  are  properly  normalized 

S'1  »  rowfe,-)  is  an  n  by  n  matrix  whose  columns 
are  the  eigenvectors  of  M,  allowing  us  to  trans¬ 
form  the  simultaneous  differential  equations  1.1 
through  1.3  into  a  matrix  differential  equation5 
in  the  form 

S  =  MCSMS*1.  SMS']]S  (1.4) 

T  *  SMS*1  (1.5) 

where  W[  ,  ]  is  in  an  appropriate  matrix  valued 

function  of  two  matrix  valued  variables  (which 
defines  the  coefficients  of  1.3)  and  T  is  a  diag¬ 
onal  matrix  of  eigenvalues.  As  such,  the  simul¬ 
taneous  differential  equations  1.1  through  1.3  may 
be  viewed  as  a  differential  equation  in  the  simi¬ 
larity  transformation  which  diagonalizes  M.  Un¬ 
fortunately,  this  similarity  transformation  is 
typically  non-soarse,  even  when  M  is  sparse  and 
therefore  fails  tj  yield  a  computationally  viable 

continuation  algpr-thm.10 

This  difficulty  is  alleviated  in  the  present 
paper  by  formulating  a  continuation  algorithm 
around  similarity  transformations  which  triangu- 
larizes,  rather  than  di agona 1 i zes  ,  M.  Such  simi¬ 
larity  transformations  preserve  the  sparseness  of 
M  while  the  eigenvalues  of  M  are  given  by  the 
diagonal  entries  of  the  resultant  triangular 
matrix.  In  the  following  section  we  formulate  a 
continuation  algorithm,  which  may  be  viewed  as  a 
continuous  LU  algorithm.9  This  algorithm  employs 
a  unit  upper  triangular  matrix  to  transform  M  into 
a  lower  triangular  form. 

In  the  continuation  algorithm,  the  required 
differential  equation  takes  the  form  of  1.4  where 
W[  ,  ]  is  the  solution  of  an  appropriate 

triangular  commutant  equation 

Um  *  u[  T  W  -  W  T  ]  (1.6) 

Here  1C  »  SMS*^,  T  *  SMS’\  and  u[  ]  is  the  operator 
which  zeros  out  all  entries  on  or  below  the  diago¬ 
nal  of  a  matrix.  This  solution  of  the  resultant 
triangular  comutant  equation  is  discussed  In 
section  III.  An  analytic  expression  for  the 
solution  is  given  which  is  amenable  to  a  simple 
recursive  computational  procedure  which  preserves 
the  sparseness  of  the  given  matrices.  Several  ex¬ 
amples  of  the  continuous  LU  algorithm  are  discussed 


f 


in  section  IV. 

1 1 .  Continuation  Algorithm 

We  are  interested  in  a  decomposition  of  the 
form  . 

T  *  SMS'1  (2.1) 

where  M  (*M(r))  is  our  given  parameterized  family 
of  matrices  S  (*S(r))  is  an  appropriate  family  of 
similarity  transformations,  and  T  («T(r))  is  lower 

triangular.  In  this  case  U[T]  *  0  which  together 
with  the  matrix  equality 

(S'1)  *  -S^SS'1  (2.2) 

yields 

SMS*1  -  T  -  -SMS'1  - SM ( S' 1 ) 

*  SMS'Hs*1  -  SS*1SMS'1  *  TW  -  Iff 

where  W  *  SS’1.  Finally,  since  U[T]  *  0  this  re¬ 
duces  to  the  desired  triangular  commutant  equation 

“[SMS'1]  *  U[TW  -  WT]  (2.3) 


of  the  equality.  Since  u[  ]  zeros  out  all  entries 
on  or  below  the  diagonal,  it  suffices  to  consider 
the  case  1  «.  1  <  j.  Upon  invoking  the  fact  that 
X  is  strictly  upper  triangular  and  L  is  lower 
triangular  we  then  obtain 
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Here  we  have  used  the  fact  that  diagonal  entries 
of  L  are  the  eigenvalues  of  M,  i.e.,  L-ji  *  X.j. 
Assuming  distinct  eigenvalues,  this  equation  may 
be  solved  for  X<i  yielding 

n  1-1 

=  [0,4  +  l  XL.  -  l 
k*j+l  KJ  k*l 
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L1kXkj> 


/  (xi  -  Xj) 
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(3.2) 


S  =  WS 

A  Continuous  LU  Algorithm:  In  the  classical 
LU  (or  LR)  algorithm  for  computing  the  eigenvalues 
of  a  single  sparse  matrix,  a  unit  upper  triangular 
similarity  transformation,  U,  which  triangularizes 
the  given,  M,  via 

L  »  UMU' 1  (2.4) 

is  computed.  As  such,  the  triangular  equation 
reduces  to 

“[UMU*1]  =  U[LX  -  XL] 

U  =  XU  (2.5) 

where  X  *  UU  1  is  strictly  upper  triangular  (since 

U  is  strictly  upper  triangular  and  U"1  is  upper 
triangular).  Since  X  is  strictly  upper  triangular 
the  above  triangular  comutant  equation  represents 
n(n-l)/2  equations  in  n(n-l)/2  unknowns  which  must 

be  solved  to  compute  X  *  XCUMU'1  .UMU*1]  and  U.  Of 
course,  once  0  is  known,  any  standard  numerical  in¬ 
tegration  technique  can  be  used  to  compute  U(r) 

and  L(r)  =  U(r)H(r)U" 1 (r)  given  appropriate  con¬ 
ditions  (which  may  be  obtained  via  the  classical 
LU  algorithm). 

III.  Solution  of  the  Triangular  Comutant  Equations 

The  key  to  the  viability  of  the  continuation 
algorithm  described  in  the  preceeding  section  is 
the  existence  of  an  easily  computed  solution  to 
the  triangular  comutant  equation.  For  this 
algorithm  we  must  solve 

UCD]  *  U[LX  -  XL]  (2.5) 

for  a  strictly  upper  triangular  X  given  0  *  UMU’1 

and  a  lower  triangular  L  *  UMU*1.  Although  no 
matrix  algebraic  solution  to  2.5  is  apparent,  a 
recursive  algorithm  for  the  solution  of  2.5  may  be 
obtained  by  expanding  the  i-j  entry  on  both  sides 


The  resultant  X..J  is  clearly  linear  and  continuous 
in  D.j.  Moreover,  the  equation  can  be  solved  re¬ 
cursively  by  starting  with  i  *  1  and  j  *  n  to 
compute  X^n.  Then  X^  n  ^  may  be  computed  in  terms 

of  Xin  and  the  given  matrices.  This  information 
is  then  used  to  conpi  e  X1  n  etc.  In  general, 

we  may  compute  X^  in  terns  of  X rs  where  r  <  i  *  i 
and  s  >  j.  As  such,  X^,  1  <_  i  <  j,  may  be  com¬ 
puted  recursively  by  increasing  i  and  decreasing 
j.  Of  course,  since  X  is  strictly  upper  triangular 

Xij  '  0  1  ^  -1  -  n  <3-3> 

while  the  formula  of  equation  3.2  is  readily  im¬ 
plemented  in  a  sparse  matrix  algorithm  and  pre- 
servi  j  the  sparsity  of  the  given  matrices. 

THEOREM  1 :  Let  M  have  distinct  eigenvalues  and 

L  *  UMU"1  be  lower  triangular.  Then  the  tri¬ 
angular  commutant  equation 

U[0]  *  UiLX  -  XL] 

admits  a  unique  strictly  upper  triangular 
solution  which  may  be  computed  recursively  via 
eqiatopms  3.2  amd  3.3.  □ 

Finally,  we  note  that  the  above  triangular 
comutant  equation  is  a  special  case  of  the  general 
equation 

C  =  AX  +  XB  (3.4) 

I 

Because  of  the  triangular  nature  of  our  arrays, 
however,  the  above  described  recursive  formula  for 
the  triangular  commutant  equation  is  far  simpler 
than  the  various  algorithms  which  have  been  pro¬ 
posed  for  the  solution  of  the  general  equation. 

See  for  instance  the  paper  by  Sartels  and  Stewart? 
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IV.  Examples 


and 


To  illustrate  the  numerical  accuracy  of  the 
continuation  algorithms  presented,  the  LU  algo¬ 
rithm  was  employed  to  compute  the  eigenvalues  of 
families  of  matrices. 


.  *  i(l+r+/r  )  i  ■  1,2,  ....  n 
and 


EXAMPLE  1:  The  given  matrix  M, 

M(r)  -  Tfr^rmr)'1 

where  T(r)  and  (r)  are  n  dimensional  matrices 
whose  elements  are  given  by 


Tii 

*  1 

i  3  1.2.  . 

...  n. 

T2i 

»  1 

i  *  1,2.  . 

...  n/2 

Trn 

*  r 

Tij 

*  0 

elsewhere. 

*  0  elsewhere. 

’r1  was  allowed  to  vary  from  0  to  1.  Table  1 
illustrates  the  results  for  various  matrix 
dimensions.  In  general,  as  the  dimension  of  the 
matrix  increased,  the  step  size  decreased. 

Table  2  compares  step  sizes.  P.  was  varied 
from  0  to  0.01  in  1  step,  10  steps  and  100  steps 
The  numerical  error  resulting  from  these  computa 
tions  seem  to  decrease  linearly  with  step  size. 
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EXAMPLE  2:  The  matrix  M(r)  is  given  by 

•  1  1  *  1.2,  ....  n. 

•W1  "  1  1  *  ’*2 . "-1' 

M1n  *  r‘ 

«  0  elsewhere. 

Table  3  compares  the  results  for  different 
dimension  matrices  with  the  eigenvalues  calculat¬ 
ed  by  solving  the  characteristic  equation  of  the 
matrix  at  r  *  1. 
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V.  Conclusion 

Although  continuation  algorithms  have  histor¬ 
ically  proven  their  usefulness  in  the  solution  of 
"small"  numerical  problems  the  classfca?  differ¬ 
ential  equations  modeling  the  various  numerical 
processes  are  not  compatible  with  sparse  matrix 
techniques.  The  present  work  coupled  with  a  pre¬ 
vious  paper  in  which  a  continuation  algorithm  for 
the  inversion  of  sparse  matrices  is  formulated,8 
however,  indicate  that  the  concept  can  be  made 
compatible  with  sparse  matrix  techniques.8'6 
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CONTINUATION  ALGORITHMS  FOR  THE  EIGENVALUE  PROBLEM 


B.  Green,  R.  Seeks  and  K.-S.  Chao 
Department  of  Electrical  Engineering 
Texas  Tech  University 
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Abstract 

The  eigenvalue  problem  for  a  continuously  parameterized  family  of  sparse  matrices,  M(r),  often 
arises  in  stability  analysis.  Typically,  one  employs  a  classical  eigenvalue  package  at  a  sequence  of 
parameter  values,  possibly  with  soecial  software  to  expolit  the  coimon  sparsity  pattern  of  the  various 
matrices.  Alternatively,  one  can  compute  the  eigenvalues  at  an  initial  parameter  value  and  "continue 
the  result"  by  integrating  an  appropriate  differential  equation  whose  trajectories  define  the  eigen¬ 
value  loci  of  the  given  family  of  matrices.  The  most  coiwion  such  differential  equation  for  this  pur- 
oose,  however,  employs  the  eigenvectors  as  an  auxiliary  variable  which  destroys  the  sparseness  of  the 
problem  since  the  array  of  eigenvectors  for  a  sparse  matrix  is  typically  non-sparse.  As  such,  the 
comoutational  benef i ts  of  working  with  the  sparse  matrix  M  will  be  lost  if  one  attempts  to  integrate 
such  an  equation. 

This  difficulty  is  alleviated  in  the  present  paper  by  formulating  continuation  algorithms  around 
a  family  of  similarity  transformations ,  S(r),  which  triangularize  M(r).  Such  similarity  transforma¬ 
tions  preserve  the  sparseness  of  M  while  the  eigenvalues  of  M  are  given  by  the  diagonal  entries  of  the 
resultant  family  of  triangular  matrices,  T(r).  He  formulate  three  such  continuation  algorithms.  The 
first,  which  may  be  viewed  as  a  continuous  LU  (or  LR)  algorithm,  employs  a  unit  upper  triangular 
matrix.  S  to  transform  M  into  lower  triangular  form.  The  second,  which  may  be  viewed  as  a  continuous 
QR  algorithm,  uses  a  unitary  matrix  to  transform  M  into  lower  triangular  form.  Finally,  our  third  al¬ 
gorithm  uses  an  upper  triangular  matrix  to  transform  M  into  lower  Hessenberg  form. 

In  each  of  the  three  continuation  algorithms  the  required  differential  equation  takes  the  form 


ds  . 
3F  ' 


rcdMc-l 

*CSd?S 


T  *  SMS'1 


SMS*1 IS 


where  Wf  ,  1  is  the  solution  of  an  appropriate  Ciuingu&tt  comma taut  equation 

“CS^S'1]  »  UCSMS'1H  -  WSMS*1  ] 

and  ur  1  is  the  operator  which  zeros  out  all  entries  on  or  below  the  diagonal  of  a  matrix.  In  each 
case  an  analytic  expression  for  the  solution  of  the  required  triangular  coiratutant  equation  is  given  ■ 
which  is  amenable  to  a  simple  recursive  computational  procedure  which  preserves  the  sparseness  of  the 
given  matrices. 


*  This  research  supported  in  part  by  the  Joint  Services  Electronics  Program  at  Texas  Tech  University, 
under  ONR  Contract  76-C-1176. 
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Abstract  of 

OPTIMAL  SELECTION  OF  IC  FABRICATION  PARAMETERS 


C.  Karmokolias,  W.  Portnoy,  and  R.  Saeks 


Abstract 


A  procedure  is  described  in  which  the  output  characteristics  of  an 
integrated  circuit  are  optimized  with  respect  to  a  set  of  variable 
fabrication  parameters.  A  simple  RC  coupled  audio  amplifier  is  used  as 
an  example.  The  gain-bandwidth  product  is  obtained  as  a  function  of 
oxidation  and  diffusion  times  and  temperatures,  and  the  optimization  is 
performed  by  way  of  a  line  search  using  these  variables  as  the  parameters 
of  the  optimization.  The  values  established  for  the  process  parameters 
are  consistent  with  those  employed  for  conventional  fabrication,  and  desired 
changes  in  performance  can  be  obtained,  in  general,  by  a  straightforward 
readjustment  of  the  values  of  the  process  variables.  Although  limited 
by  certain  assumptions  and  a  relatively  primitive  circuit,  the  results 
demonstrate  the  validity  of  the  procedure. 
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